00000001:02000400:3.0F:1787383043.992218:0:3301:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787383061.503091:0:3524:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1787383063.516540:0:3587:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 507 MB/s 00000001:01000000:2.0:1787383063.766067:0:3587:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 439 MB/s 00000001:01000000:2.0:1787383064.016349:0:3587:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3839 MB/s 00000020:02000000:2.0:1787383064.696721:0:3617:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_114_g76b937b 00000400:02000000:2.0:1787383065.706891:0:3631:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.102@tcp [8/256/0/180] 00008000:02000000:2.0:1787383069.431258:0:3780:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787383127.548162:0:5746:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787383141.893341:0:6496:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787383141.893348:0:6496:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787383141.893349:0:6496:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787383141.893486:0:6496:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000f80b3208 00000080:02000400:2.0:1787383141.893496:0:6496:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787383141.906018:0:6496:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787383141.906197:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787383141.906234:0:6496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ec119e15) 00000020:00000080:2.0:1787383141.906252:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787383141.995021:0:6496:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787383141.995110:0:6496:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1787383142.024870:0:6496:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787383142.025079:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787383142.025087:0:6496:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787383142.025100:0:6496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532df9a 00000020:01000004:1.0:1787383142.025105:0:6496:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787383142.025109:0:6496:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787383142.025113:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f80b3208 from MGS 00000020:01000004:1.0:1787383142.025118:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787383142.025278:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005c030e76) 00000020:00000080:1.0:1787383142.025292:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787383142.025390:0:6496:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f80b3208 from MGS, refs=2 00080000:01000000:1.0:1787383142.025395:0:6496:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787383142.025401:0:6496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532dfa8 00000100:00100000:1.0:1787383142.025490:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787383142.025592:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787383142.025597:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787383142.027130:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787383142.027148:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787383142.028467:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383142.028655:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787383142.028660:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0F:1787383142.030359:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787383142.030380:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787383142.030841:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787383142.030847:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787383142.031622:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383142.031625:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383142.031627:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383142.032128:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383142.032130:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383142.032132:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383142.032689:0:6496:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787383142.035279:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787383142.281853:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1751 MB/s 00000001:01000000:2.0:1787383142.532610:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2163 MB/s 00000001:01000000:0.0:1787383142.781870:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 375 MB/s 00000001:01000000:2.0:1787383143.041635:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 652 MB/s 00010000:00010000:2.0:1787383143.069024:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787383143.073064:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1787383143.098631:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787383143.104994:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787383143.105112:0:6496:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787383143.105182:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787383143.105427:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787383143.105451:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787383143.106787:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787383143.106943:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787383143.106950:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787383143.128661:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787383143.128676:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787383143.129690:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787383143.129698:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787383143.130374:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787383143.130393:0:6496:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.102@tcp' 00000020:01000004:0.0:1787383143.130394:0:6496:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787383143.130442:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.102@tcp (typ=mgc) 00000020:00000080:0.0:1787383143.130460:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.102@tcp (000000000511ba06) 00000020:00000080:0.0:1787383143.130477:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787383143.130607:0:6496:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001f802a9b@MGC192.168.203.102@tcp: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1787383143.130803:0:6496:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.102@tcp-0 is initialized 00000040:01000000:0.0:1787383143.130809:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787383143.133301:0:6516:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787383143.135748:0:6517:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787383143.135812:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.102@tcp (uuid 68140aec-1198-480f-b348-a4187c7bb1d1) 00000020:00000080:3.0:1787383143.135835:0:6496:0:(genops.c:1406:class_connect()) connect: client 68140aec-1198-480f-b348-a4187c7bb1d1, cookie 0xc40acec91532dfb6 00000100:00080000:3.0:1787383143.135846:0:6496:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787383143.135850:0:6496:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import 000000001f802a9b using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383143.135888:0:6496:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002176faf4 x1874206984765568/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787383143.135959:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002176faf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68140aec-1198-480f-b348-a4187c7bb1d1:3646:1874206984765568:0@lo:250: 00000100:00100000:3.0:1787383143.136005:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787383143.136057:0:6496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 68140aec-1198-480f-b348-a4187c7bb1d1->MGS 00000100:00100000:0.0:1787383143.136267:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984765568 00000100:00100000:0.0:1787383143.136275:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984765568 00000100:00100000:0.0:1787383143.136303:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383143.136309:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd019433 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1874206984765568:12345-0@lo:250: 00010000:00080000:0.0:1787383143.136330:0:6512:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 68140aec-1198-480f-b348-a4187c7bb1d1@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:0.0:1787383143.136351:0:6512:0:(genops.c:1406:class_connect()) connect: client 68140aec-1198-480f-b348-a4187c7bb1d1, cookie 0xc40acec91532dfbd 00000100:00080000:0.0:1787383143.136467:0:6512:0:(import.c:65:import_set_state_nolock()) 000000004b1282ef : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383143.138905:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd019433 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+5:3646:x1874206984765568:12345-0@lo:250: Request processed in 2589us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.138920:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383143.138986:0:3646:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787383143.138995:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.102@tcp: connect to target with instance 0 00000100:00080000:0.0:1787383143.139003:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787383143.139007:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787383143.139018:0:3646:0:(import.c:65:import_set_state_nolock()) 000000001f802a9b MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787383143.139020:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787383143.139032:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787383143.139037:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002176faf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68140aec-1198-480f-b348-a4187c7bb1d1:3646:1874206984765568:0@lo:250: 00000020:01000004:3.0:1787383143.140614:0:6496:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787383143.140660:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787383143.140704:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ecacb436) 00000020:00000080:3.0:1787383143.140721:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787383143.164271:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787383143.164458:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787383143.164465:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787383143.179290:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787383143.179312:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787383143.184269:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787383143.184281:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787383143.185365:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383143.185546:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787383143.185552:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787383143.186477:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787383143.186494:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787383143.240681:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383143.240919:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787383143.240925:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787383143.246880:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787383143.246899:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787383143.251321:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787383143.251548:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787383143.251555:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787383143.254476:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787383143.254506:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787383143.256153:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787383143.256334:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787383143.256340:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787383143.256921:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787383143.256929:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787383143.257502:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787383143.257654:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787383143.257659:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787383143.259453:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787383143.259468:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787383143.296484:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787383143.296819:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787383143.296825:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787383143.305561:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787383143.305579:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787383143.306414:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787383143.306421:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787383143.307754:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787383143.307976:0:6496:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787383143.307982:0:6496:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787383143.308151:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787383143.308199:0:6496:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.102@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787383143.308203:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787383143.308205:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787383143.308206:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383143.308207:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383143.308208:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383143.308209:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383143.308211:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787383143.308212:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787383143.308213:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787383143.308214:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787383143.308215:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383143.308217:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787383143.308219:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787383143.308221:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787383143.308222:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787383143.308223:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383143.308224:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383143.308225:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383143.308226:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383143.308227:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787383143.308228:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787383143.308229:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787383143.308230:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787383143.308231:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383143.308232:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787383143.308262:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787383143.308279:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fee39e33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984765696:0@lo:253: 00000100:00100000:1.0:1787383143.308342:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383143.308419:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 00000000795271d5 going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.308466:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984765696 00000100:00100000:0.0:1787383143.308473:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984765696 00000100:00100000:0.0:1787383143.308633:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383143.308641:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdef52de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+5:6496:x1874206984765696:12345-0@lo:253: 20000000:01000000:0.0:1787383143.308677:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787383143.308679:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787383143.308986:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787383143.309035:0:6515:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787383143.309323:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383143.310290:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787383143.314331:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787383143.314338:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787383143.314343:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787383143.314346:0:6515:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787383143.314356:0:6515:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787383143.314534:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383143.314690:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787383143.314705:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787383143.314724:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787383143.314739:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787383143.314752:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787383143.314840:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787383143.314849:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787383143.314862:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787383143.314867:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787383143.314879:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787383143.314884:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787383143.314895:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787383143.314907:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787383143.314933:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787383143.314938:0:6515:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787383143.314944:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383143.315028:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787383143.315038:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787383143.315052:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787383143.315067:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787383143.315093:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787383143.315102:0:6515:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787383143.315127:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787383143.315135:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787383143.315158:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787383143.315174:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787383143.315187:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787383143.315696:0:6515:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787383143.315733:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787383143.315742:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787383143.315755:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787383143.315810:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787383143.315864:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787383143.315886:0:6515:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787383143.315893:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787383143.318344:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787383143.318714:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787383143.318742:0:6515:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.102@tcp for mdt 20000000:01000000:1.0:1787383143.318745:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:1.0:1787383143.318762:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787383143.318956:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787383143.318976:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787383143.318981:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:1.0:1787383143.318993:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787383143.319000:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787383143.319012:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787383143.319026:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787383143.319051:0:6515:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787383143.319054:0:6515:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787383143.319057:0:6515:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787383143.319228:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787383143.319230:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787383143.322455:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787383143.322696:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787383143.322733:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787383143.322746:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1787383143.322757:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787383143.322798:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787383143.323581:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787383143.323896:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787383143.323915:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787383143.323927:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1787383143.323935:0:6515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787383143.323937:0:6515:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787383143.323941:0:6515:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787383143.323944:0:6515:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787383143.323949:0:6515:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787383143.323953:0:6515:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787383143.324343:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787383143.324494:0:6515:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787383143.334361:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1787383143.334401:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1787383143.334420:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1787383143.334438:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787383143.334458:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000063c86932/0xc40acec91532dfcb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.334474:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000063c86932/0xc40acec91532dfcb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.334482:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000063c86932/0xc40acec91532dfcb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.334488:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000063c86932/0xc40acec91532dfcb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.334493:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000063c86932/0xc40acec91532dfcb lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.334500:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000063c86932/0xc40acec91532dfcb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.334520:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000063c86932 already unused, calling callback (00000000b55119d6) 00010000:00010000:1.0:1787383143.334524:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000063c86932/0xc40acec91532dfcb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.334531:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000063c86932/0xc40acec91532dfcb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.334542:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000063c86932/0xc40acec91532dfcb lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.334549:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000063c86932/0xc40acec91532dfcb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.334554:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000063c86932/0xc40acec91532dfcb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787383143.334569:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787383143.342564:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdef52de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+5:6496:x1874206984765696:12345-0@lo:253: Request processed in 33915us (34214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383143.342585:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383143.342949:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fee39e33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984765696:0@lo:253: 10000000:01000000:3.0:1787383143.342965:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787383143.342968:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787383143.342970:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787383143.342971:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383143.342972:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787383143.342973:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383143.342975:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383143.342976:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787383143.342978:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787383143.342979:0:6496:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787383143.342980:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383143.342981:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787383143.343000:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f80b3208 from lustre-MDT0000 10000000:01000000:3.0:1787383143.343027:0:6496:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787383143.343030:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787383143.343034:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9636345a8000 10000000:01000000:3.0:1787383143.343040:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787383143.343047:0:6496:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9636345a8000 from 1 10000000:01000000:3.0:1787383143.343049:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787383143.343083:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.343094:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.343101:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383143.343145:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d6c286e pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984765824:0@lo:101: 00000100:00100000:3.0:1787383143.343181:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383143.343232:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000074b6c2c2 going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.343345:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984765824 00000100:00100000:0.0:1787383143.343351:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984765824 00000100:00100000:0.0:1787383143.343393:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383143.343410:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6ccfdb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+5:6496:x1874206984765824:12345-0@lo:101: 00010000:00010000:0.0:1787383143.343422:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383143.343436:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008c3d5866/0xc40acec91532dfd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532dfd2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.343457:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008c3d5866/0xc40acec91532dfd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532dfd2 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.343466:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008c3d5866/0xc40acec91532dfd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532dfd2 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.343474:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008c3d5866, rc 0) 00000100:00100000:0.0:1787383143.343512:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6ccfdb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+6:6496:x1874206984765824:12345-0@lo:101: Request processed in 103us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.343518:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383143.343705:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d6c286e pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984765824:0@lo:101: 00010000:00010000:1.0:1787383143.343718:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532dfd9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.343726:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532dfd9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383143.344225:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d5ff8d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984765952:0@lo:501: 00000100:00100000:1.0:1787383143.344284:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383143.344391:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 000000000741e6bf going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.344709:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984765952 00000100:00100000:0.0:1787383143.344715:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984765952 00000100:00100000:0.0:1787383143.344820:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383143.344828:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000932b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+6:6496:x1874206984765952:12345-0@lo:501: 00000100:00100000:0.0:1787383143.344914:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000932b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+6:6496:x1874206984765952:12345-0@lo:501: Request processed in 87us (630us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787383143.344921:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383143.345032:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d5ff8d1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984765952:0@lo:501: 10000000:01000000:2.0:1787383143.345066:0:6496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787383143.345219:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532dfd9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383143.345231:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532dfd9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383143.345240:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9636064d1800 10000000:01000000:2.0:1787383143.345244:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787383143.345249:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9636064d1800 10000000:01000000:2.0:1787383143.345252:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787383143.345255:0:6496:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9636064d1800 from 1 10000000:01000000:2.0:1787383143.345257:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787383143.345351:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 000000006580008f/0xc40acec91532dfe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383143.345359:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 000000006580008f/0xc40acec91532dfe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383143.345365:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 000000006580008f/0xc40acec91532dfe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383143.345377:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000059263747 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984766080:0@lo:101: 00000100:00100000:2.0:1787383143.345413:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383143.345634:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 00000000752e43a4 going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.345727:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984766080 00000100:00100000:0.0:1787383143.345732:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984766080 00000100:00100000:0.0:1787383143.345788:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787383143.345794:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ade3ea59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+6:6496:x1874206984766080:12345-0@lo:101: 00010000:00010000:0.0:1787383143.345803:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383143.345814:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ddca1b20/0xc40acec91532dfe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532dfe0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.345838:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ddca1b20/0xc40acec91532dfe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532dfe0 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.345846:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ddca1b20/0xc40acec91532dfe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532dfe0 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.345855:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ddca1b20, rc 0) 00000100:00100000:0.0:1787383143.345885:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ade3ea59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+7:6496:x1874206984766080:12345-0@lo:101: Request processed in 92us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.345890:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383143.348253:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000059263747 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984766080:0@lo:101: 00010000:00010000:3.0:1787383143.348278:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 000000006580008f/0xc40acec91532dfe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.348290:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 000000006580008f/0xc40acec91532dfe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383143.348307:0:6496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787383143.348365:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 000000006580008f/0xc40acec91532dfe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.348373:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 000000006580008f/0xc40acec91532dfe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383143.348380:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787383143.348389:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787383143.348394:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9636064d1800 10000000:01000000:3.0:1787383143.348399:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787383143.348402:0:6496:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787383143.348405:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787383143.348432:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.348438:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.348460:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383143.348476:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984766208:0@lo:101: 00000100:00100000:3.0:1787383143.348539:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383143.348576:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000074b6c2c2 going to sleep for 11 seconds 00000100:00100000:1.0:1787383143.348672:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984766208 00000100:00100000:1.0:1787383143.348679:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984766208 00000100:00100000:1.0:1787383143.348728:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383143.348735:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e50187f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+7:6496:x1874206984766208:12345-0@lo:101: 00010000:00010000:1.0:1787383143.348746:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383143.348757:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b1ebb9cd/0xc40acec91532dff5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532dfee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.348794:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1ebb9cd/0xc40acec91532dff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532dfee expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.348803:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b1ebb9cd/0xc40acec91532dff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532dfee expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.348811:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b1ebb9cd, rc 0) 00000100:00100000:1.0:1787383143.348843:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e50187f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+8:6496:x1874206984766208:12345-0@lo:101: Request processed in 108us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383143.348850:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383143.348919:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984766208:0@lo:101: 00010000:00010000:3.0:1787383143.348929:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532dff5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.348936:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532dff5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383143.348998:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984766336:0@lo:501: 00000100:00100000:3.0:1787383143.349022:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383143.349050:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000074b6c2c2 going to sleep for 11 seconds 00000100:00100000:3.0:1787383143.349069:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984766336 00000100:00100000:3.0:1787383143.349072:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984766336 00000100:00100000:3.0:1787383143.349094:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383143.349100:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da3a8fe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+8:6496:x1874206984766336:12345-0@lo:501: 00000100:00100000:3.0:1787383143.349223:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da3a8fe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+9:6496:x1874206984766336:12345-0@lo:501: Request processed in 123us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383143.349231:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383143.349255:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984766336:0@lo:501: 00000100:00100000:3.0:1787383143.349278:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984766464:0@lo:503: 00000100:00100000:3.0:1787383143.349323:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383143.349332:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000074b6c2c2 going to sleep for 11 seconds 00000100:00100000:3.0:1787383143.349350:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984766464 00000100:00100000:3.0:1787383143.349354:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984766464 00000100:00100000:3.0:1787383143.349371:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383143.349376:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000074c4a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+9:6496:x1874206984766464:12345-0@lo:503: 00000100:00100000:3.0:1787383143.349453:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000074c4a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+9:6496:x1874206984766464:12345-0@lo:503: Request processed in 78us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383143.349460:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383143.349505:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984766464:0@lo:503: 00000100:00100000:0.0:1787383143.352993:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ee02cb89 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:6542:1874206984766592:0@lo:502: 00000100:00100000:0.0:1787383143.353057:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383143.353095:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set 000000005cd176d4 going to sleep for 11 seconds 00000100:00100000:2.0:1787383143.354098:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984766592 00000100:00100000:2.0:1787383143.354107:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984766592 00000100:00100000:2.0:1787383143.354231:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383143.354240:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046eb6941 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+9:6542:x1874206984766592:12345-0@lo:502: 00000100:00100000:2.0:1787383143.354457:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046eb6941 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+9:6542:x1874206984766592:12345-0@lo:502: Request processed in 217us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383143.354473:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787383143.356397:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ee02cb89 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:6542:1874206984766592:0@lo:502: 00000020:01000000:0.0:1787383143.356440:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383143.356452:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383143.356454:0:6542:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787383143.356459:0:6542:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787383143.356462:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383143.359434:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000054d0b3e1) 00000020:00000080:0.0:1787383143.359459:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787383143.359472:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787383143.359739:0:6542:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787383143.359746:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532e003 00000020:00000080:0.0:1787383143.360093:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787383143.360099:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383143.360103:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383143.360105:0:6542:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787383143.360113:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383143.360118:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383143.360119:0:6542:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787383143.360123:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383143.360144:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000091d63e2a) 00000020:00000080:0.0:1787383143.360155:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787383143.360159:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787383143.360161:0:6542:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787383143.360164:0:6542:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787383143.360169:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787383143.360223:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f80b3208 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787383143.360234:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e97bdc85) 00000020:00000080:0.0:1787383143.360241:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787383143.360306:0:6542:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787383143.360311:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532e018 00000020:00000080:0.0:1787383143.360413:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787383143.360419:0:6542:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787383143.360424:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc40acec91532e01f 00080000:01000000:0.0:1787383143.360428:0:6542:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787383143.360430:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532e026 00080000:10000000:0.0:1787383143.361336:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1787383143.361478:0:6542:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787383143.367324:0:6542:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787383143.546958:0:6542:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787383143.550686:0:6542:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787383143.555024:0:6542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787383143.556034:0:6542:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787383143.572309:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001568fea6) 00000020:00000080:2.0:1787383143.572333:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787383143.572407:0:6542:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787383143.572414:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532e034 00000020:00000080:3.0:1787383143.575424:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787383143.576260:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1787383143.594620:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1787383143.597027:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1787383143.601920:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1787383143.610106:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1787383143.613952:0:6542:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1787383143.616029:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc40acec91532e03b 00000020:00000080:2.0:1787383143.619388:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787383143.619404:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383143.619416:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383143.619419:0:6542:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787383143.619423:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383143.619427:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383143.619428:0:6542:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787383143.619431:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787383143.619432:0:6542:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787383143.619435:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383143.619437:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383143.619438:0:6542:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787383143.619441:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383143.619444:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383143.619445:0:6542:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787383143.619451:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787383143.619664:0:6542:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787383143.619729:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000aef33680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:6542:1874206984766720:0@lo:502: 00000100:00100000:2.0:1787383143.619962:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383143.620042:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f697c29c going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.620443:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984766720 00000100:00100000:0.0:1787383143.620452:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984766720 00000100:00100000:0.0:1787383143.620663:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787383143.620680:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000751e094f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+9:6542:x1874206984766720:12345-0@lo:502: 00000100:00100000:0.0:1787383143.620845:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000751e094f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+9:6542:x1874206984766720:12345-0@lo:502: Request processed in 166us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.620854:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787383143.620938:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000aef33680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:6542:1874206984766720:0@lo:502: 00000020:01000000:2.0:1787383143.620972:0:6542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383143.620978:0:6542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383143.620980:0:6542:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787383143.620984:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787383143.621161:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787383143.621185:0:6496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787383143.621217:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532dff5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.621229:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532dff5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383143.621236:0:6496:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9636064d1800 from 1 10000000:01000000:3.0:1787383143.621238:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787383143.621266:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.621273:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.621280:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383143.621301:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984766848:0@lo:101: 00000100:00100000:3.0:1787383143.621670:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383143.621797:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075ba16d3 going to sleep for 11 seconds 00000100:00100000:1.0:1787383143.621892:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984766848 00000100:00100000:1.0:1787383143.621898:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984766848 00000100:00100000:1.0:1787383143.621927:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787383143.621934:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040d1af69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+9:6496:x1874206984766848:12345-0@lo:101: 00010000:00010000:1.0:1787383143.621944:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383143.621957:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000063c86932/0xc40acec91532e049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e042 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.621977:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000063c86932/0xc40acec91532e049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e042 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.621993:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000063c86932/0xc40acec91532e049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e042 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.622001:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000063c86932, rc 0) 00000100:00100000:1.0:1787383143.622039:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040d1af69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+10:6496:x1874206984766848:12345-0@lo:101: Request processed in 106us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383143.622046:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383143.622136:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984766848:0@lo:101: 00010000:00010000:3.0:1787383143.622148:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e049 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.622156:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e049 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383143.622966:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984766976:0@lo:256: 00000100:00100000:3.0:1787383143.623010:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383143.623111:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075ba16d3 going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.623281:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984766976 00000100:00100000:0.0:1787383143.623287:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984766976 00000100:00100000:0.0:1787383143.623325:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383143.623331:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be8ab5c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+10:6496:x1874206984766976:12345-0@lo:256: 20000000:01000000:0.0:1787383143.623345:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787383143.623350:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787383143.623414:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be8ab5c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+10:6496:x1874206984766976:12345-0@lo:256: Request processed in 84us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.623420:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383143.623532:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984766976:0@lo:256: 10000000:01000000:3.0:1787383143.624088:0:6496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787383143.624106:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e049 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.624116:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e049 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383143.624125:0:6496:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9636064d1800 from 1 10000000:01000000:3.0:1787383143.624267:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383143.624294:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.624302:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.624320:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383143.624334:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984767104:0@lo:101: 00000100:00100000:3.0:1787383143.624367:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383143.624398:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075ba16d3 going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.624455:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984767104 00000100:00100000:0.0:1787383143.624460:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984767104 00000100:00100000:0.0:1787383143.624484:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787383143.624490:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e2cdb05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+10:6496:x1874206984767104:12345-0@lo:101: 00010000:00010000:0.0:1787383143.624499:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383143.624510:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e522f6d0/0xc40acec91532e057 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e050 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.624527:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e522f6d0/0xc40acec91532e057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e050 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.624536:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e522f6d0/0xc40acec91532e057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e050 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.624543:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e522f6d0, rc 0) 00000100:00100000:0.0:1787383143.624587:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e2cdb05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+11:6496:x1874206984767104:12345-0@lo:101: Request processed in 97us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.624593:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383143.624941:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984767104:0@lo:101: 00010000:00010000:3.0:1787383143.624953:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e057 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.624961:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e057 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383143.625017:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984767232:0@lo:501: 00000100:00100000:3.0:1787383143.625041:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383143.625066:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075ba16d3 going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.625113:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984767232 00000100:00100000:0.0:1787383143.625117:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984767232 00000100:00100000:0.0:1787383143.625145:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787383143.625151:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008000aa8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+11:6496:x1874206984767232:12345-0@lo:501: 00000100:00100000:0.0:1787383143.625302:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008000aa8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+11:6496:x1874206984767232:12345-0@lo:501: Request processed in 151us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.625315:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787383143.625500:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984767232:0@lo:501: 00000100:00100000:3.0:1787383143.625524:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984767360:0@lo:503: 00000100:00100000:3.0:1787383143.625563:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383143.625585:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075ba16d3 going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.625722:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984767360 00000100:00100000:0.0:1787383143.625726:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984767360 00000100:00100000:0.0:1787383143.625744:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383143.625749:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ce5d77a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+11:6496:x1874206984767360:12345-0@lo:503: 00000040:00080000:0.0:1787383143.625824:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383143.625858:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ce5d77a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+11:6496:x1874206984767360:12345-0@lo:503: Request processed in 109us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.625864:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787383143.625935:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f4a2c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984767360:0@lo:503: 00000040:00080000:3.0:1787383143.626822:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787383143.627117:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787383143.627148:0:6496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383143.627168:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e057 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.627179:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e057 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383143.627234:0:6496:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787383143.627237:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9636064d1800 10000000:01000000:0.0:1787383143.627240:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9636064d1800 10000000:01000000:0.0:1787383143.627250:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383143.627256:0:6496:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9636064d1800 from 1 10000000:01000000:0.0:1787383143.627259:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787383143.627287:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.627293:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.627302:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383143.627332:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ee02cb89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984767488:0@lo:101: 00000100:00100000:0.0:1787383143.627373:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383143.627401:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e9c1eee9 going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.627417:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984767488 00000100:00100000:0.0:1787383143.627422:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984767488 00000100:00100000:0.0:1787383143.627447:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383143.627452:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ca15ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+11:6496:x1874206984767488:12345-0@lo:101: 00010000:00010000:0.0:1787383143.627462:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383143.627471:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000075c50f5c/0xc40acec91532e065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e05e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.627503:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075c50f5c/0xc40acec91532e065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e05e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.627512:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000075c50f5c/0xc40acec91532e065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e05e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.627520:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000075c50f5c, rc 0) 00000100:00100000:0.0:1787383143.627556:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ca15ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:6496:x1874206984767488:12345-0@lo:101: Request processed in 104us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.627562:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383143.627602:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ee02cb89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984767488:0@lo:101: 00010000:00010000:0.0:1787383143.627613:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e065 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.627619:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e065 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383143.627661:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ee02cb89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984767616:0@lo:501: 00000100:00100000:0.0:1787383143.627682:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383143.627695:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e9c1eee9 going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.627707:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984767616 00000100:00100000:0.0:1787383143.627710:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984767616 00000100:00100000:0.0:1787383143.627725:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787383143.627730:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000b8c8e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:6496:x1874206984767616:12345-0@lo:501: 00000100:00100000:0.0:1787383143.627848:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000b8c8e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:6496:x1874206984767616:12345-0@lo:501: Request processed in 118us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.627855:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787383143.627883:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ee02cb89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984767616:0@lo:501: 00000100:00100000:0.0:1787383143.627906:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ee02cb89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984767744:0@lo:503: 00000100:00100000:0.0:1787383143.627939:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383143.627956:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e9c1eee9 going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.627968:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984767744 00000100:00100000:0.0:1787383143.627971:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984767744 00000100:00100000:0.0:1787383143.627986:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787383143.627995:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064b596a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:6496:x1874206984767744:12345-0@lo:503: 00000100:00100000:0.0:1787383143.628061:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064b596a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:6496:x1874206984767744:12345-0@lo:503: Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.628067:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787383143.628106:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ee02cb89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984767744:0@lo:503: 00000100:00100000:0.0:1787383143.628309:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ee02cb89 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:6547:1874206984767872:0@lo:502: 00000100:00100000:0.0:1787383143.628343:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383143.628360:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984767872 00000100:00100000:0.0:1787383143.628364:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984767872 00000100:00100000:0.0:1787383143.628380:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787383143.628384:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068969682 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:6547:x1874206984767872:12345-0@lo:502: 00000100:00100000:0.0:1787383143.628458:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068969682 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:6547:x1874206984767872:12345-0@lo:502: Request processed in 74us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.628465:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787383143.628491:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set 000000004c72be7b going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.628501:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ee02cb89 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:6547:1874206984767872:0@lo:502: 00000020:01000004:0.0:1787383143.628546:0:6547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787383143.628566:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000074798c19) 00000020:00000080:0.0:1787383143.628582:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787383143.628728:0:6547:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f80b3208 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787383143.628732:0:6547:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f80b3208 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787383143.628734:0:6547:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f80b3208 4 00010000:00080000:0.0:1787383143.628759:0:6547:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f9a75689@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1787383143.640972:0:6547:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787383143.641084:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787383143.642231:0:6547:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787383143.642251:0:6547:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc40acec91532e073 00000100:00080000:0.0:1787383143.642261:0:6547:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383143.642266:0:6547:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f9a75689 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383143.642302:0:6547:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ee02cb89 x1874206984768000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383143.642740:0:6547:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787383143.643086:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ee02cb89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984768000:0@lo:38: 00000100:00100000:3.0:1787383143.643162:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383143.643616:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984768000 00000100:00100000:2.0:1787383143.643624:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984768000 00000100:00100000:2.0:1787383143.643653:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383143.643659:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f4a2c33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984768000:12345-0@lo:38: 00000100:00100000:2.0:1787383143.643721:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f4a2c33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984768000:12345-0@lo:38: Request processed in 61us (560us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787383143.643727:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383143.643792:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787383143.643798:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000f9a75689 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383143.643802:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787383143.643804:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ee02cb89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984768000:0@lo:38: 00000100:00100000:0.0:1787383143.646322:0:6547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:6547:1874206984768128:0@lo:502: 00000100:00100000:0.0:1787383143.654555:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383143.654603:0:6547:0:(client.c:2702:ptlrpc_set_wait()) set 000000004c72be7b going to sleep for 11 seconds 00000100:00100000:1.0:1787383143.654652:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984768128 00000100:00100000:1.0:1787383143.654660:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984768128 00000100:00100000:1.0:1787383143.654701:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787383143.654708:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a08efd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:6547:x1874206984768128:12345-0@lo:502: 00000100:00100000:1.0:1787383143.654863:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a08efd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:6547:x1874206984768128:12345-0@lo:502: Request processed in 156us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383143.654871:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787383143.655158:0:6547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:6547:1874206984768128:0@lo:502: 00000040:00080000:0.0:1787383143.655201:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787383143.655499:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787383143.655519:0:6496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787383143.655539:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e065 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.655550:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e065 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787383143.655598:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787383143.655601:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787383143.655602:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383143.655603:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383143.655604:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383143.655605:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383143.655606:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787383143.655610:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787383143.655611:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787383143.655612:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787383143.655613:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383143.655614:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787383143.655617:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787383143.655619:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787383143.655620:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787383143.655621:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383143.655622:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383143.655622:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383143.655623:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383143.655624:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787383143.655625:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787383143.655625:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787383143.655626:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787383143.655627:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383143.655627:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787383143.655646:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787383143.655660:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000deb3bb65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984768256:0@lo:253: 00000100:00100000:1.0:1787383143.655696:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383143.655715:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set 00000000795271d5 going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.655872:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984768256 00000100:00100000:0.0:1787383143.655877:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984768256 00000100:00100000:0.0:1787383143.655902:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787383143.655908:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ab0a962 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+12:6496:x1874206984768256:12345-0@lo:253: 20000000:01000000:0.0:1787383143.655927:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787383143.655940:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787383143.668246:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787383143.668267:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787383143.668636:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ab0a962 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+12:6496:x1874206984768256:12345-0@lo:253: Request processed in 12724us (12937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.668650:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787383143.668744:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000deb3bb65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:6496:1874206984768256:0@lo:253: 10000000:01000000:2.0:1787383143.668758:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787383143.668761:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787383143.668821:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787383143.668823:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383143.668824:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383143.668825:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383143.668827:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383143.668828:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383143.668829:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787383143.668830:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787383143.668832:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787383143.668833:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383143.668835:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787383143.668853:0:6496:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787383143.670183:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787383143.670201:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787383143.670226:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.670243:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000063c86932/0xc40acec91532e049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e042 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.670251:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.670289:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000063c86932/0xc40acec91532e049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e042 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.670337:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000063c86932/0xc40acec91532e049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e042 expref: 11 pid: 6514 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383143.670351:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000752ff660 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984768384:0@lo:104: 00000100:00100000:1.0:1787383143.670405:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383143.670457:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set 00000000282f6b26 going to sleep for 11 seconds 00000100:00100000:0.0:1787383143.670597:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984768384 00000100:00100000:0.0:1787383143.670604:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984768384 00000100:00100000:0.0:1787383143.670651:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383143.670658:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7815884 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+3:6536:x1874206984768384:12345-0@lo:104: 00010000:00010000:0.0:1787383143.670669:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e049 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383143.670722:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787383143.670727:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7815884 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+3:6536:x1874206984768384:12345-0@lo:104: Request processed in 70us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383143.670734:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383143.670786:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000752ff660 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984768384:0@lo:104: 00010000:00010000:0.0:1787383143.670804:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.673879:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383143.673902:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e049 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.673914:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002cdd8af8 already unused, calling callback (0000000045fc936d) 10000000:00010000:3.0:1787383143.673917:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e049 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.673926:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e049 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383143.673933:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e049 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383143.673938:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787383143.673979:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e049 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.673985:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383143.674004:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e049 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.674010:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e049 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.674024:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383143.674026:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383143.674027:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383143.674091:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b12d7504 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984768512:0@lo:103: 00000100:00100000:3.0:1787383143.674150:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383143.678431:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984768512 00000100:00100000:3.0:1787383143.678445:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984768512 00010000:00010000:3.0:1787383143.678500:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000063c86932/0xc40acec91532e049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e042 expref: 12 pid: 6514 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383143.678543:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383143.678551:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbb93feb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+12:3648:x1874206984768512:12345-0@lo:103: 00010000:00010000:3.0:1787383143.678564:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383143.678569:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000063c86932/0xc40acec91532e049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e042 expref: 12 pid: 6514 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.678581:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000063c86932/0xc40acec91532e049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e042 expref: 12 pid: 6514 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.678597:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000063c86932/0xc40acec91532e049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e042 expref: 12 pid: 6514 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.678613:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.678620:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787383143.678635:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008434574s 00010000:00010000:3.0:1787383143.678639:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.678645:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.678651:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.678656:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.678669:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000051f98376 already unused, calling callback (00000000b55119d6) 00010000:00010000:3.0:1787383143.678673:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.678679:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.678692:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383143.678702:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383143.678786:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbb93feb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+11:3648:x1874206984768512:12345-0@lo:103: Request processed in 236us (4636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383143.678794:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383143.678844:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b12d7504 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984768512:0@lo:103: 00010000:00010000:1.0:1787383143.678957:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.678965:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383143.678971:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000051f98376/0xc40acec91532e07a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1787383143.687761:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1787383143.687968:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787383143.688197:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1787383143.688370:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787383143.688555:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1787383143.688737:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1787383143.692624:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1787383143.692836:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1787383143.693094:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1787383143.693280:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1787383143.693484:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1787383143.693640:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1787383143.711917:0:6496:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787383143.750515:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787383143.750871:0:6552:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787383143.750876:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787383143.751002:0:6553:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787383143.752363:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787383143.752469:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787383143.752910:0:6496:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787383143.752919:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787383143.753015:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383143.753918:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787383143.763014:0:6553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383143.767631:0:6553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787383143.767707:0:6553:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787383143.767712:0:6553:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1787383143.768994:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787383143.769057:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787383143.773794:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787383143.774205:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1787383143.783855:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787383143.784026:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787383143.784183:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787383143.785386:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787383143.785530:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787383143.785663:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787383143.786133:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787383143.786278:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787383143.786471:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787383143.787729:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787383143.788721:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787383143.789414:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787383143.789648:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787383143.791597:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787383143.792042:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787383143.792181:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787383143.795656:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787383143.795946:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787383143.796109:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787383143.796260:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787383143.796424:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787383143.796571:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787383143.796706:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787383143.796867:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787383143.796994:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787383143.797155:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787383143.797309:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787383143.797456:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787383143.797583:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787383143.797730:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787383143.797890:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787383143.798029:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787383143.798234:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1787383143.807057:0:6496:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787383143.807097:0:6496:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb73d819b7988 00100000:10000000:3.0:1787383143.807105:0:6496:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787383143.807888:0:6496:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787383143.807906:0:6496:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787383143.807924:0:6496:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787383143.807940:0:6496:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787383143.808673:0:6496:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383143.808895:0:6496:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787383144.100357:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383145.125385:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383146.139450:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383147.164749:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383148.186958:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787383148.698874:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787383148.698882:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9636064d1800 from 3 10000000:01000000:0.0:1787383148.698886:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787383148.698931:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383148.698943:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383148.698952:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383148.698988:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984768640:0@lo:101: 00000100:00100000:0.0:1787383148.699051:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383148.699101:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da5fc556 going to sleep for 11 seconds 00000100:00100000:3.0:1787383148.701577:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984768640 00000100:00100000:3.0:1787383148.701592:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984768640 00000100:00100000:3.0:1787383148.701651:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787383148.701659:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023fe1a6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+11:6517:x1874206984768640:12345-0@lo:101: 00010000:00010000:3.0:1787383148.701677:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383148.701695:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002cdd8af8/0xc40acec91532e088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e081 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383148.701722:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002cdd8af8/0xc40acec91532e088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e081 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383148.701733:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002cdd8af8/0xc40acec91532e088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e081 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383148.701740:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002cdd8af8, rc 0) 00000100:00100000:3.0:1787383148.701821:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023fe1a6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+12:6517:x1874206984768640:12345-0@lo:101: Request processed in 163us (2770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383148.701828:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787383148.701939:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787383148.701944:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787383148.701947:0:8:0:(import.c:65:import_set_state_nolock()) 00000000f9a75689 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383148.701954:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f9a75689 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383148.701980:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000811274c0 x1874206984768768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383148.702032:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984768640:0@lo:101: 00010000:00010000:0.0:1787383148.702046:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e088 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383148.702054:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e088 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383148.702105:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984768896:0@lo:256: 00000100:00100000:0.0:1787383148.702139:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383148.702175:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da5fc556 going to sleep for 11 seconds 00000100:00100000:0.0:1787383148.702188:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984768896 00000100:00100000:0.0:1787383148.702192:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984768896 00000100:00100000:0.0:1787383148.702216:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787383148.702221:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f561fd24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+12:6517:x1874206984768896:12345-0@lo:256: 20000000:01000000:0.0:1787383148.702233:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787383148.702246:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787383148.702253:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787383148.702321:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f561fd24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+12:6517:x1874206984768896:12345-0@lo:256: Request processed in 100us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383148.702328:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787383148.702355:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984768896:0@lo:256: 10000000:01000000:0.0:1787383148.702387:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787383148.702393:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e088 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383148.702399:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e088 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383148.702649:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000811274c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984768768:0@lo:38: 00000100:00100000:3.0:1787383148.702688:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383148.702920:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984768768 00000100:00100000:0.0:1787383148.702926:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984768768 00000100:00100000:0.0:1787383148.702955:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383148.702959:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b12d7504 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1874206984768768:12345-0@lo:38: 00010000:00080000:0.0:1787383148.702977:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:0.0:1787383148.703010:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc40acec91532e08f 00000004:00100000:0.0:1787383148.703050:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787383148.703145:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000e325c32f : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383148.703206:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b12d7504 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874206984768768:12345-0@lo:38: Request processed in 245us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383148.703213:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787383148.703549:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000811274c0 x1874206984768768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787383148.703563:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787383148.703570:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787383148.703574:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787383148.703576:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000f9a75689 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787383148.703581:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000811274c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984768768:0@lo:38: 00010000:00010000:3.0:1787383149.212087:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787383149.288044:0:6797:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787383150.235267:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787383150.370530:0:6850:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383150.370740:0:6850:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787383151.261991:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383152.283247:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787383153.275191:0:6951:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787383153.275380:0:6951:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787383153.312352:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383153.819013:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984769024:0@lo:400: 00000100:00100000:3.0:1787383153.819094:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383153.819157:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383153.819163:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f17c102 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984769152:0@lo:400: 00000100:00100000:3.0:1787383153.819191:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383153.819272:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984769152 00000100:00100000:3.0:1787383153.819281:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984769152 00000100:00100000:3.0:1787383153.819322:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383153.819330:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b90bc97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984769152:12345-0@lo:400: 00000100:00100000:3.0:1787383153.819394:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b90bc97 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984769152:12345-0@lo:400: Request processed in 64us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383153.819401:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787383153.819443:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009f17c102 x1874206984769152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383153.819457:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f17c102 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984769152:0@lo:400: 00000100:00100000:0.0:1787383153.819634:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984769024 00000100:00100000:0.0:1787383153.819645:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984769024 00000100:00100000:0.0:1787383153.819681:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787383153.819687:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf5ce1af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+12:3649:x1874206984769024:12345-0@lo:400: 00000100:00100000:0.0:1787383153.819724:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf5ce1af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+12:3649:x1874206984769024:12345-0@lo:400: Request processed in 37us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383153.819730:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787383153.819981:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984769024:0@lo:400: 00010000:00010000:1.0:1787383154.339124:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383155.356639:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383156.379297:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383157.403121:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383158.426911:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383158.938902:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044026eda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984769280:0@lo:400: 00000100:00100000:2.0:1787383158.938967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383158.939103:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008dbf6491 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984769408:0@lo:400: 00000100:00100000:3.0:1787383158.939139:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383158.939200:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984769408 00000100:00100000:3.0:1787383158.939207:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984769408 00000100:00100000:3.0:1787383158.939252:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383158.939261:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4b04848 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984769408:12345-0@lo:400: 00000100:00100000:3.0:1787383158.939316:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4b04848 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984769408:12345-0@lo:400: Request processed in 57us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383158.939322:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787383158.940399:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008dbf6491 x1874206984769408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383158.940417:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008dbf6491 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984769408:0@lo:400: 00000100:00100000:0.0:1787383158.942168:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984769280 00000100:00100000:0.0:1787383158.942180:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984769280 00000100:00100000:0.0:1787383158.942232:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787383158.942240:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa535d0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:3647:x1874206984769280:12345-0@lo:400: 00000100:00100000:0.0:1787383158.942321:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa535d0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:3647:x1874206984769280:12345-0@lo:400: Request processed in 82us (3355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383158.942329:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787383158.942588:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044026eda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984769280:0@lo:400: 00010000:00010000:2.0:1787383159.451061:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383160.475489:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383161.499434:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383162.522963:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787383162.714478:0:7449:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787383162.714483:0:7449:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787383162.714484:0:7449:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787383162.714597:0:7449:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000933e8eca 00000020:01000004:3.0:1787383162.714613:0:7449:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1787383162.714625:0:7449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787383162.714637:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000009a3674af) 00000020:00000080:3.0:1787383162.714651:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787383162.788890:0:7449:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1787383162.788980:0:7449:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1787383162.830576:0:7449:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787383162.830886:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787383162.830895:0:7449:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787383162.830907:0:7449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532e09d 00000020:01000004:1.0:1787383162.830912:0:7449:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787383162.830938:0:7449:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787383162.830941:0:7449:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787383162.830946:0:7449:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787383162.830973:0:7449:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787383162.830977:0:7449:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787383162.862711:0:7449:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787383162.862752:0:7449:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.102@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1787383162.862756:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787383162.862757:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787383162.862759:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383162.862788:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383162.862789:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383162.862791:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383162.862792:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787383162.862793:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787383162.862794:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787383162.862795:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383162.862796:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787383162.862800:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1787383162.862802:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787383162.862803:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787383162.862804:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383162.862805:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383162.862806:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383162.862807:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383162.862808:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787383162.862808:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787383162.862809:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787383162.862810:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383162.862811:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787383162.862833:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787383162.862848:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a0d8fe33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984769536:0@lo:253: 00000100:00100000:3.0:1787383162.862911:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383162.863014:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 000000004fa5e0ef going to sleep for 11 seconds 00000100:00100000:0.0:1787383162.863157:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984769536 00000100:00100000:0.0:1787383162.863164:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984769536 00000100:00100000:0.0:1787383162.863267:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787383162.863276:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4b54f52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+12:7449:x1874206984769536:12345-0@lo:253: 20000000:01000000:0.0:1787383162.863304:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787383162.863308:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1787383162.863312:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1787383162.863315:0:6512:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1787383162.863349:0:6512:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1787383162.863529:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383162.863982:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787383162.864117:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787383162.864141:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1787383162.864169:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1787383162.864183:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1787383162.864241:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1787383162.864249:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1787383162.864261:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1787383162.864266:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1787383162.864276:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1787383162.864281:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1787383162.864293:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1787383162.864307:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1787383162.864407:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1787383162.864416:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:0.0:1787383162.864431:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1787383162.864436:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787383162.864447:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1787383162.864453:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:0.0:1787383162.864464:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1787383162.864469:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787383162.864480:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1787383162.864494:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1787383162.864503:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787383162.865327:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1787383162.865341:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1787383162.865353:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1787383162.865368:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1787383162.865384:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1787383162.865390:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1787383162.865403:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1787383162.865972:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1787383162.865982:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1787383162.866091:0:6512:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787383162.866099:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1787383162.866401:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1787383162.866716:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787383162.866737:0:6512:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.102@tcp for mdt 20000000:01000000:1.0:1787383162.866739:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:1.0:1787383162.866753:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787383162.866759:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787383162.866896:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787383162.866904:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:1.0:1787383162.866922:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787383162.866929:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1787383162.866942:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1787383162.866958:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1787383162.867006:0:6512:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1787383162.867013:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1787383162.867666:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1787383162.867970:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787383162.867989:0:6512:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.203.102@tcp for mdt 20000000:01000000:1.0:1787383162.867991:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:1.0:1787383162.868005:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787383162.868011:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787383162.868023:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787383162.868028:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:1.0:1787383162.868040:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787383162.868071:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1787383162.868156:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787383162.868173:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1787383162.868191:0:6512:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787383162.868194:0:6512:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787383162.868197:0:6512:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787383162.868240:0:6512:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787383162.868242:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787383162.869164:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787383162.869192:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787383162.869201:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787383162.869304:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1787383162.869326:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1787383162.869343:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1787383162.869353:0:6512:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787383162.869355:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787383162.869804:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787383162.869827:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787383162.869841:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1787383162.870021:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1787383162.870040:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1787383162.870066:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1787383162.870135:0:6512:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787383162.870138:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787383162.870388:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787383162.870620:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787383162.870699:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787383162.870826:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787383162.870843:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787383162.870871:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787383162.870883:0:6512:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787383162.870886:0:6512:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787383162.870890:0:6512:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787383162.870896:0:6512:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787383162.871205:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1787383162.871253:0:6512:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787383162.883888:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787383162.883917:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.883956:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008c3d5866/0xc40acec91532dfd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532dfd2 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.883962:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b1ebb9cd/0xc40acec91532dff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532dfee expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.883968:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000075c50f5c/0xc40acec91532e065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e05e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.883974:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.884014:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000075c50f5c/0xc40acec91532e065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e05e expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.884037:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000075c50f5c/0xc40acec91532e065 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e05e expref: 12 pid: 6515 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383162.884050:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000074cb48d7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1874206984769664:0@lo:104: 00000100:00100000:1.0:1787383162.884127:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383162.884191:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b1ebb9cd/0xc40acec91532dff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532dfee expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383162.884194:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984769664 00010000:00010000:1.0:1787383162.884202:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b1ebb9cd/0xc40acec91532dff5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532dfee expref: 12 pid: 6514 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383162.884204:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984769664 00000100:00100000:1.0:1787383162.884215:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000396f8de4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1874206984769792:0@lo:104: 00000100:00100000:1.0:1787383162.884241:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383162.884470:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008c3d5866/0xc40acec91532dfd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532dfd2 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.884484:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008c3d5866/0xc40acec91532dfd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532dfd2 expref: 12 pid: 6514 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383162.884491:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000004e2e982 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1874206984769920:0@lo:104: 00000100:00100000:1.0:1787383162.884526:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383162.885026:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984769792 00000100:00100000:3.0:1787383162.885033:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984769792 00000100:00100000:3.0:1787383162.885142:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383162.885149:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad3cf719 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+4:6512:x1874206984769664:12345-0@lo:104: 00010000:00010000:3.0:1787383162.885163:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e065 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.885230:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383162.885241:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cc279edc going to sleep for 11 seconds 00000100:00100000:3.0:1787383162.885245:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad3cf719 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+4:6512:x1874206984769664:12345-0@lo:104: Request processed in 95us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383162.885255:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383162.885266:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000074cb48d7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1874206984769664:0@lo:104: 00000100:00100000:3.0:1787383162.885277:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984769920 00000100:00100000:3.0:1787383162.885282:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984769920 00000100:00100000:3.0:1787383162.885299:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787383162.885304:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bb9227e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+4:6512:x1874206984769792:12345-0@lo:104: 00010000:00010000:3.0:1787383162.885311:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532dff5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885328:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383162.885335:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e065 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885344:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ac06eb3b already unused, calling callback (0000000045fc936d) 10000000:00010000:2.0:1787383162.885347:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e065 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.885352:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787383162.885355:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e065 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383162.885359:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bb9227e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+4:6512:x1874206984769792:12345-0@lo:104: Request processed in 54us (1117us total) trans 0 rc 0/0 10000000:00010000:2.0:1787383162.885371:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e065 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383162.885375:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:2.0:1787383162.885383:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787383162.885393:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383162.885401:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039c86be1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+3:6512:x1874206984769920:12345-0@lo:104: 00010000:00010000:3.0:1787383162.885408:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532dfd9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885417:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e065 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885425:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383162.885438:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787383162.885445:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039c86be1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+3:6512:x1874206984769920:12345-0@lo:104: Request processed in 45us (918us total) trans 0 rc 0/0 00010000:00010000:2.0:1787383162.885446:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e065 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383162.885455:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787383162.885468:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 00000000ac06eb3b/0xc40acec91532e05e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e065 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885483:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383162.885486:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532dff5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885520:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a2433e6 already unused, calling callback (0000000045fc936d) 10000000:00010000:2.0:1787383162.885523:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532dff5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885529:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532dff5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383162.885534:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532dff5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383162.885539:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383162.885839:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532dff5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885846:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383162.885851:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532dff5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885856:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 000000004a2433e6/0xc40acec91532dfee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532dff5 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885867:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383162.885869:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532dfd9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885875:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006b2391c7 already unused, calling callback (0000000045fc936d) 10000000:00010000:2.0:1787383162.885877:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532dfd9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885892:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532dfd9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383162.885897:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532dfd9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383162.885902:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383162.885913:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532dfd9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885919:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383162.885937:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532dfd9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885942:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 000000006b2391c7/0xc40acec91532dfd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532dfd9 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.885955:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383162.885956:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383162.885958:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383162.885976:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000aef33680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984770048:0@lo:103: 00000100:00100000:2.0:1787383162.886012:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383162.886022:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006a001900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984770304:0@lo:103: 00000100:00100000:2.0:1787383162.886370:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383162.886376:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000029e87ac7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984770176:0@lo:103: 00000100:00100000:2.0:1787383162.886395:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383162.886423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383162.886447:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984770048 00000100:00100000:2.0:1787383162.886462:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984770048 00010000:00010000:2.0:1787383162.886482:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000075c50f5c/0xc40acec91532e065 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e05e expref: 13 pid: 6515 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383162.886616:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984770176 00000100:00100000:2.0:1787383162.886620:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984770176 00010000:00010000:2.0:1787383162.886689:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b1ebb9cd/0xc40acec91532dff5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532dfee expref: 14 pid: 6514 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383162.886702:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984770304 00000100:00100000:2.0:1787383162.886704:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984770304 00010000:00010000:2.0:1787383162.886713:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008c3d5866/0xc40acec91532dfd9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532dfd2 expref: 15 pid: 6514 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383162.886725:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383162.886731:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dac5660e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+15:3649:x1874206984770048:12345-0@lo:103: 00010000:00010000:2.0:1787383162.886741:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383162.886745:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000075c50f5c/0xc40acec91532e065 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e05e expref: 15 pid: 6515 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.886754:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000075c50f5c/0xc40acec91532e065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e05e expref: 15 pid: 6515 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.886785:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000075c50f5c/0xc40acec91532e065 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e05e expref: 15 pid: 6515 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.886798:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383162.886826:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dac5660e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+14:3649:x1874206984770048:12345-0@lo:103: Request processed in 95us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383162.886832:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383162.886847:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787383162.886852:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f361dc51 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+13:3649:x1874206984770176:12345-0@lo:103: 00010000:00010000:2.0:1787383162.886867:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383162.886871:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b1ebb9cd/0xc40acec91532dff5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532dfee expref: 13 pid: 6514 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.886879:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b1ebb9cd/0xc40acec91532dff5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532dfee expref: 13 pid: 6514 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.886888:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383162.886908:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f361dc51 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+13:3649:x1874206984770176:12345-0@lo:103: Request processed in 57us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383162.886915:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787383162.886926:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383162.886931:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c36b7af0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+12:3647:x1874206984770304:12345-0@lo:103: 00010000:00010000:2.0:1787383162.886938:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383162.886941:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008c3d5866/0xc40acec91532dfd9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532dfd2 expref: 12 pid: 6514 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.886949:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008c3d5866/0xc40acec91532dfd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532dfd2 expref: 12 pid: 6514 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.886959:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.886965:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.886977:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.886983:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.886995:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.887001:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.887006:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000051f98376 already unused, calling callback (00000000b55119d6) 00010000:00010000:2.0:1787383162.887010:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.887238:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.887248:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.887259:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383162.887284:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c36b7af0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+12:3647:x1874206984770304:12345-0@lo:103: Request processed in 354us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383162.887291:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383162.887319:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006a001900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984770304:0@lo:103: 00000100:00100000:2.0:1787383162.887347:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000029e87ac7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984770176:0@lo:103: 00000100:00100000:2.0:1787383162.887354:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000aef33680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984770048:0@lo:103: 00010000:00010000:1.0:1787383162.887754:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b1ebb9cd/0xc40acec91532dff5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532dfee expref: 11 pid: 6514 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383162.887922:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000396f8de4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1874206984769792:0@lo:104: 00010000:00010000:1.0:1787383162.887937:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008c3d5866/0xc40acec91532dfd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532dfd2 expref: 10 pid: 6514 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383162.887945:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000004e2e982 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1874206984769920:0@lo:104: 00010000:00010000:1.0:1787383162.887964:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.887972:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.887977:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.887981:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000051f98376/0xc40acec91532e0a4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787383162.887997:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:1.0:1787383162.888843:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383162.898693:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4b54f52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+9:7449:x1874206984769536:12345-0@lo:253: Request processed in 35412us (35774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383162.898708:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787383162.898800:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a0d8fe33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984769536:0@lo:253: 10000000:01000000:0.0:1787383162.898817:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787383162.898829:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787383162.898831:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787383162.898833:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383162.898835:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1787383162.898836:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383162.898839:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383162.898841:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787383162.898843:0:7449:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787383162.898845:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383162.898846:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787383162.898868:0:7449:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000933e8eca from lustre-MDT0001 10000000:01000000:0.0:1787383162.898899:0:7449:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787383162.898901:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787383162.898908:0:7449:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9636345a8000 local copy 10000000:01000000:0.0:1787383162.898913:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787383162.898944:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383162.898954:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383162.898963:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383162.898980:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d017e761 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984770432:0@lo:101: 00000100:00100000:0.0:1787383162.899015:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383162.899081:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0e1fc1a going to sleep for 11 seconds 00000100:00100000:2.0:1787383162.899595:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984770432 00000100:00100000:2.0:1787383162.899603:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984770432 00000100:00100000:2.0:1787383162.899651:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787383162.899659:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079769eee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+9:7449:x1874206984770432:12345-0@lo:101: 00010000:00010000:2.0:1787383162.899682:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383162.899696:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e42e0c21/0xc40acec91532e0b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e0ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.899721:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e42e0c21/0xc40acec91532e0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e0ab expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.899730:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e42e0c21/0xc40acec91532e0b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e0ab expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.899739:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e42e0c21, rc 0) 00000100:00100000:2.0:1787383162.899815:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079769eee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+10:7449:x1874206984770432:12345-0@lo:101: Request processed in 157us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383162.899822:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787383162.899926:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d017e761 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984770432:0@lo:101: 00010000:00010000:0.0:1787383162.899941:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc40acec91532e0b2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383162.899949:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc40acec91532e0b2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383162.900067:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d017e761 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984770560:0@lo:501: 00000100:00100000:0.0:1787383162.900099:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383162.900127:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0e1fc1a going to sleep for 11 seconds 00000100:00100000:1.0:1787383162.900160:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984770560 00000100:00100000:1.0:1787383162.900165:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984770560 00000100:00100000:1.0:1787383162.900200:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383162.900207:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008893180b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+10:7449:x1874206984770560:12345-0@lo:501: 00000100:00100000:1.0:1787383162.900272:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008893180b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+10:7449:x1874206984770560:12345-0@lo:501: Request processed in 66us (172us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787383162.900285:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383162.900292:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d017e761 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984770560:0@lo:501: 10000000:01000000:3.0:1787383162.900310:0:7449:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787383162.900334:0:7449:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787383162.900339:0:7449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc40acec91532e0b2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.900347:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc40acec91532e0b2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.900354:0:7449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc40acec91532e0b2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.900377:0:7449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787383162.900400:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9636183cf000 10000000:01000000:3.0:1787383162.900405:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787383162.900410:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9636345a8000 10000000:01000000:3.0:1787383162.900412:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787383162.900416:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9636345a8000 from 1 10000000:01000000:3.0:1787383162.900418:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787383162.900436:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000fb643326/0xc40acec91532e0b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.900443:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000fb643326/0xc40acec91532e0b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.900450:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000fb643326/0xc40acec91532e0b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383162.900462:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984770688:0@lo:101: 00000100:00100000:3.0:1787383162.900629:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383162.900708:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383162.900714:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc40acec91532e0b2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.900722:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006eb2abb9 already unused, calling callback (0000000045fc936d) 10000000:00010000:2.0:1787383162.900724:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc40acec91532e0b2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.900731:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc40acec91532e0b2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383162.900738:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc40acec91532e0b2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383162.900743:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383162.900761:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc40acec91532e0b2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.900807:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383162.900829:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc40acec91532e0b2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.900835:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 000000006eb2abb9/0xc40acec91532e0ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc40acec91532e0b2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.900851:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383162.900852:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383162.900854:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383162.900862:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383162.900872:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000aef33680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984770816:0@lo:103: 00000100:00100000:2.0:1787383162.900901:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383162.900937:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984770816 00000100:00100000:2.0:1787383162.900942:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984770816 00000100:00100000:2.0:1787383162.900982:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383162.900989:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787383162.900990:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029e87ac7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+10:3647:x1874206984770816:12345-0@lo:103: 00010000:00010000:2.0:1787383162.901003:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787383162.901011:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787383162.901017:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e42e0c21/0xc40acec91532e0b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e0ab expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383162.901034:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383162.901081:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029e87ac7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+9:3647:x1874206984770816:12345-0@lo:103: Request processed in 93us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383162.901088:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383162.901206:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 000000006482cc2a going to sleep for 11 seconds 00000100:00100000:1.0:1787383162.901242:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000aef33680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984770816:0@lo:103: 00000100:00100000:0.0:1787383162.902020:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984770688 00000100:00100000:0.0:1787383162.902027:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984770688 00000100:00100000:1.0:1787383162.902118:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787383162.902127:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc6cfeb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+9:7449:x1874206984770688:12345-0@lo:101: 00010000:00010000:1.0:1787383162.902138:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383162.902153:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000051f98376/0xc40acec91532e0c0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e0b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.902171:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051f98376/0xc40acec91532e0c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e0b9 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.902181:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000051f98376/0xc40acec91532e0c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e0b9 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.902188:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000051f98376, rc 0) 00000100:00100000:1.0:1787383162.902234:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc6cfeb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+10:7449:x1874206984770688:12345-0@lo:101: Request processed in 107us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383162.902239:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787383162.902330:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984770688:0@lo:101: 00010000:00010000:3.0:1787383162.902345:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000fb643326/0xc40acec91532e0b9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e0c0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.902354:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000fb643326/0xc40acec91532e0b9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e0c0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383162.902370:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787383162.902385:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000fb643326/0xc40acec91532e0b9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e0c0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.902391:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000fb643326/0xc40acec91532e0b9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e0c0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383162.902402:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9636183cf000 10000000:01000000:3.0:1787383162.902406:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787383162.902410:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9636183cf000 from 1 10000000:01000000:3.0:1787383162.902412:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787383162.902427:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000debe3c4e/0xc40acec91532e0c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.902434:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000debe3c4e/0xc40acec91532e0c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.902440:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000debe3c4e/0xc40acec91532e0c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383162.902739:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984770944:0@lo:101: 00000100:00100000:3.0:1787383162.902797:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383162.902831:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 000000006482cc2a going to sleep for 11 seconds 00000100:00100000:0.0:1787383162.902892:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984770944 00000100:00100000:0.0:1787383162.902897:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984770944 00000100:00100000:0.0:1787383162.902931:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787383162.902938:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038b3fe10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+10:7449:x1874206984770944:12345-0@lo:101: 00010000:00010000:0.0:1787383162.902948:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383162.902957:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045bb1fa0/0xc40acec91532e0ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e0c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383162.902973:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045bb1fa0/0xc40acec91532e0ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e0c7 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383162.902982:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045bb1fa0/0xc40acec91532e0ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e0c7 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383162.902989:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045bb1fa0, rc 0) 00000100:00100000:0.0:1787383162.903017:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038b3fe10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+11:7449:x1874206984770944:12345-0@lo:101: Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383162.903024:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383162.903273:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984770944:0@lo:101: 00010000:00010000:3.0:1787383162.903284:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000debe3c4e/0xc40acec91532e0c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.903291:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000debe3c4e/0xc40acec91532e0c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383162.903304:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787383162.903317:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000debe3c4e/0xc40acec91532e0c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.903324:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000debe3c4e/0xc40acec91532e0c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383162.903331:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787383162.903335:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787383162.903339:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9636183cf000 10000000:01000000:3.0:1787383162.903341:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787383162.903344:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787383162.903347:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787383162.903370:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000013c118d/0xc40acec91532e0d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.903376:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000013c118d/0xc40acec91532e0d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.903384:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000013c118d/0xc40acec91532e0d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383162.903396:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771072:0@lo:101: 00000100:00100000:3.0:1787383162.903428:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383162.904420:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 000000006482cc2a going to sleep for 11 seconds 00000100:00100000:1.0:1787383162.904660:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984771072 00000100:00100000:1.0:1787383162.904677:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984771072 00000100:00100000:1.0:1787383162.904724:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383162.904731:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2b000cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+11:7449:x1874206984771072:12345-0@lo:101: 00010000:00010000:1.0:1787383162.904746:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383162.904761:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b1ebb9cd/0xc40acec91532e0dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e0d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.904806:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1ebb9cd/0xc40acec91532e0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e0d5 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.904815:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b1ebb9cd/0xc40acec91532e0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e0d5 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383162.904823:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b1ebb9cd, rc 0) 00000100:00100000:1.0:1787383162.904961:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2b000cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+12:7449:x1874206984771072:12345-0@lo:101: Request processed in 231us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383162.904968:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787383162.905740:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771072:0@lo:101: 00010000:00010000:3.0:1787383162.905759:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000013c118d/0xc40acec91532e0d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e0dc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383162.905877:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000013c118d/0xc40acec91532e0d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e0dc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383162.905971:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771200:0@lo:501: 00000100:00100000:3.0:1787383162.906008:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383162.906088:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 000000006482cc2a going to sleep for 11 seconds 00000100:00100000:0.0:1787383162.906215:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984771200 00000100:00100000:0.0:1787383162.906221:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984771200 00000100:00100000:0.0:1787383162.906353:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787383162.906360:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1e4ae6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+12:7449:x1874206984771200:12345-0@lo:501: 00000100:00100000:0.0:1787383162.906491:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1e4ae6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+12:7449:x1874206984771200:12345-0@lo:501: Request processed in 125us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383162.906498:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383162.906559:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771200:0@lo:501: 00000100:00100000:3.0:1787383162.906588:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771328:0@lo:503: 00000100:00100000:3.0:1787383162.906627:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383162.907041:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 000000006482cc2a going to sleep for 11 seconds 00000100:00100000:2.0:1787383162.907185:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984771328 00000100:00100000:2.0:1787383162.907191:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984771328 00000100:00100000:2.0:1787383162.907217:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787383162.907240:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000657d4c45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:7449:x1874206984771328:12345-0@lo:503: 00000100:00100000:2.0:1787383162.907332:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000657d4c45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:7449:x1874206984771328:12345-0@lo:503: Request processed in 104us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383162.907339:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787383162.907417:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771328:0@lo:503: 00000040:00080000:3.0:1787383162.907674:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787383162.907747:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771456:0@lo:502: 00000100:00100000:3.0:1787383162.907823:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383162.907842:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 000000006482cc2a going to sleep for 11 seconds 00000100:00100000:2.0:1787383162.908074:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984771456 00000100:00100000:2.0:1787383162.908079:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984771456 00000100:00100000:2.0:1787383162.908100:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787383162.908106:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b24c92f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:7449:x1874206984771456:12345-0@lo:502: 00000100:00100000:2.0:1787383162.908183:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b24c92f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:7449:x1874206984771456:12345-0@lo:502: Request processed in 77us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383162.908191:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787383162.908797:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771456:0@lo:502: 00000040:00080000:3.0:1787383162.909035:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787383162.909077:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1787383162.909092:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1787383162.909103:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1787383162.909127:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1787383162.909140:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1787383162.909152:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1787383162.909163:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1787383162.909175:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1787383162.909187:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1787383162.909199:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1787383162.909209:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1787383162.909220:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1787383162.909245:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1787383162.909259:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1787383162.909287:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1787383162.909301:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1787383162.909314:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1787383162.909323:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1787383162.909333:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1787383162.909344:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1787383162.909357:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1787383162.909368:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1787383162.909396:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771584:0@lo:502: 00000100:00100000:3.0:1787383162.909451:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383162.909482:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 000000006482cc2a going to sleep for 11 seconds 00000100:00100000:2.0:1787383162.909783:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984771584 00000100:00100000:2.0:1787383162.909790:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984771584 00000100:00100000:2.0:1787383162.909827:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787383162.909833:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6d20bb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:7449:x1874206984771584:12345-0@lo:502: 00000100:00100000:2.0:1787383162.909948:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6d20bb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:7449:x1874206984771584:12345-0@lo:502: Request processed in 114us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383162.909956:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787383162.910097:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771584:0@lo:502: 00000040:00080000:3.0:1787383162.910149:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1787383162.910158:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1787383162.911046:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383162.911073:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383162.911076:0:7462:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787383162.911083:0:7462:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1787383162.911086:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787383162.911101:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000000a757bcb) 00000020:00000080:3.0:1787383162.911129:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1787383162.911136:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787383162.911313:0:7462:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787383162.911322:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532e0ea 00000020:00000080:3.0:1787383162.915876:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1787383162.915890:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383162.915897:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383162.915899:0:7462:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1787383162.915903:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383162.915908:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383162.915910:0:7462:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1787383162.915914:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787383162.915928:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000031b70fb2) 00000020:00000080:3.0:1787383162.915951:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1787383162.915955:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787383162.915957:0:7462:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1787383162.915960:0:7462:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1787383162.915967:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787383162.916038:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000933e8eca from lustre-MDT0001, refs=2 00000020:00000080:3.0:1787383162.916085:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000002f359673) 00000020:00000080:3.0:1787383162.916096:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1787383162.916185:0:7462:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787383162.916192:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532e0ff 00000020:00000080:3.0:1787383162.916677:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1787383162.916684:0:7462:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787383162.916689:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc40acec91532e106 00080000:01000000:3.0:1787383162.916696:0:7462:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787383162.916699:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532e10d 00080000:10000000:3.0:1787383162.917188:0:7462:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1787383162.917452:0:7462:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1787383163.036413:0:7462:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1787383163.036856:0:7462:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1787383163.043109:0:7462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787383163.043855:0:7462:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787383163.060691:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787383163.060704:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383163.060710:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383163.060712:0:7462:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787383163.060715:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383163.060721:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383163.060727:0:7462:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787383163.060732:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787383163.060736:0:7462:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:00000080:2.0:1787383163.060760:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383163.060791:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000476100d6) 00000020:00000080:2.0:1787383163.060812:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787383163.060818:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787383163.060878:0:7462:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787383163.060885:0:7462:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787383163.060891:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532e11b 00010000:00080000:2.0:1787383163.060921:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c8c5a843@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1787383163.068355:0:7462:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1787383163.070307:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787383163.070323:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787383163.070358:0:7462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787383163.070380:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532e122 00000100:00080000:2.0:1787383163.070389:0:7462:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383163.070394:0:7462:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000c8c5a843 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383163.070426:0:7462:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006a001900 x1874206984771712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383163.070491:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006a001900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984771712:0@lo:38: 00000100:00100000:0.0:1787383163.070557:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787383163.073155:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787383163.073246:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383163.073252:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383163.073254:0:7462:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787383163.073257:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787383163.073260:0:7462:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787383163.073261:0:7462:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787383163.073262:0:7462:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787383163.073264:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787383163.073266:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383163.073267:0:7462:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787383163.073277:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383163.073282:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383163.073284:0:7462:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787383163.073287:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787383163.073335:0:7462:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787383163.073347:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383163.073350:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383163.073352:0:7462:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787383163.073354:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383163.073356:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383163.073357:0:7462:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787383163.073360:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787383163.073361:0:7462:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787383163.073388:0:7462:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383163.073391:0:7462:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383163.073392:0:7462:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787383163.073395:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1787383163.073568:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984771712 00000100:00100000:1.0:1787383163.073577:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984771712 00000100:00100000:1.0:1787383163.073606:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383163.073612:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028ffad0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206984771712:12345-0@lo:38: 00010000:00080000:1.0:1787383163.073635:0:6525:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:1.0:1787383163.073666:0:6525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532e129 00000004:00100000:1.0:1787383163.073679:0:6525:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787383163.073683:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:1.0:1787383163.073793:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1787383163.073820:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787383163.073833:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000013c118d/0xc40acec91532e0d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e0dc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.073849:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000013c118d/0xc40acec91532e0d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e0dc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383163.073868:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9636183cf000 from 1 10000000:01000000:1.0:1787383163.073871:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787383163.073899:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.073905:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.073913:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383163.073929:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000004e2e982 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771840:0@lo:101: 00000100:00100000:1.0:1787383163.073984:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383163.074025:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c632b21c going to sleep for 11 seconds 00000100:00100000:2.0:1787383163.074156:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984771840 00000100:00100000:2.0:1787383163.074160:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984771840 00000100:00100000:2.0:1787383163.074195:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787383163.074201:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000118955ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+12:7449:x1874206984771840:12345-0@lo:101: 00010000:00010000:2.0:1787383163.074213:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383163.074223:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e42e0c21/0xc40acec91532e137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e130 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.074241:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e42e0c21/0xc40acec91532e137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e130 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.074249:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e42e0c21/0xc40acec91532e137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e130 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.074256:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e42e0c21, rc 0) 00000100:00100000:2.0:1787383163.074299:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000118955ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+13:7449:x1874206984771840:12345-0@lo:101: Request processed in 98us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383163.074305:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787383163.074344:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000004e2e982 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771840:0@lo:101: 00010000:00010000:2.0:1787383163.074356:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e137 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.074363:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e137 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383163.074939:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007f403d22 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771968:0@lo:256: 00000100:00100000:2.0:1787383163.074973:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383163.074988:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ad39148c going to sleep for 11 seconds 00000100:00100000:1.0:1787383163.075137:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984771968 00000100:00100000:1.0:1787383163.075142:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984771968 00000100:00100000:1.0:1787383163.075172:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787383163.075178:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f91f43b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+13:7449:x1874206984771968:12345-0@lo:256: 20000000:01000000:1.0:1787383163.075191:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787383163.075206:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787383163.075209:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787383163.075276:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f91f43b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+13:7449:x1874206984771968:12345-0@lo:256: Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383163.075282:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787383163.075316:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007f403d22 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984771968:0@lo:256: 10000000:01000000:1.0:1787383163.075899:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787383163.075913:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e137 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.075922:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e137 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383163.075942:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9636183cf000 from 1 10000000:01000000:1.0:1787383163.075944:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787383163.075965:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.075971:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.075979:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383163.075992:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000396f8de4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984772096:0@lo:101: 00000100:00100000:1.0:1787383163.076403:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383163.076430:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984772096 00000100:00100000:1.0:1787383163.076435:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984772096 00000100:00100000:1.0:1787383163.076464:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787383163.076471:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000323bc96d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+13:7449:x1874206984772096:12345-0@lo:101: 00010000:00010000:1.0:1787383163.076480:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383163.076489:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003fe1653a/0xc40acec91532e145 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e13e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.076506:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003fe1653a/0xc40acec91532e145 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e13e expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.078282:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003fe1653a/0xc40acec91532e145 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e13e expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.078292:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003fe1653a, rc 0) 00000100:00100000:1.0:1787383163.078358:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000323bc96d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+14:7449:x1874206984772096:12345-0@lo:101: Request processed in 1886us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383163.078366:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787383163.078434:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bada8ca2 going to sleep for 11 seconds 00000100:00100000:1.0:1787383163.078458:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000396f8de4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984772096:0@lo:101: 00010000:00010000:1.0:1787383163.078474:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e145 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.078482:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e145 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383163.078588:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000396f8de4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984772224:0@lo:501: 00000100:00100000:1.0:1787383163.078620:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383163.078650:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984772224 00000100:00100000:1.0:1787383163.078654:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984772224 00000100:00100000:1.0:1787383163.078680:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787383163.078685:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4e072ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+14:7449:x1874206984772224:12345-0@lo:501: 00000100:00100000:1.0:1787383163.078763:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4e072ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+14:7449:x1874206984772224:12345-0@lo:501: Request processed in 78us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383163.078785:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787383163.078808:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bada8ca2 going to sleep for 11 seconds 00000100:00100000:1.0:1787383163.078820:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000396f8de4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984772224:0@lo:501: 00000100:00100000:1.0:1787383163.078858:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000396f8de4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984772352:0@lo:503: 00000100:00100000:1.0:1787383163.078895:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383163.078913:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984772352 00000100:00100000:1.0:1787383163.078916:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984772352 00000100:00100000:1.0:1787383163.078934:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787383163.078939:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005189ae6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+14:7449:x1874206984772352:12345-0@lo:503: 00000040:00080000:1.0:1787383163.078978:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787383163.079356:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383163.079366:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984772480:0@lo:400: 00000100:00100000:3.0:1787383163.079660:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383163.085628:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005189ae6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+14:7449:x1874206984772352:12345-0@lo:503: Request processed in 6681us (6725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383163.085643:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787383163.085749:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bada8ca2 going to sleep for 11 seconds 00000100:00100000:1.0:1787383163.085827:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000396f8de4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984772352:0@lo:503: 00000040:00080000:1.0:1787383163.086282:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383163.086333:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1787383163.086418:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383163.086670:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984772480 00000100:00100000:0.0:1787383163.086678:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984772480 00000100:00100000:1.0:1787383163.086802:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383163.086810:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008eac3077 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984772480:12345-0@lo:400: 00000100:00100000:1.0:1787383163.086889:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008eac3077 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984772480:12345-0@lo:400: Request processed in 81us (7231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383163.086897:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787383163.086973:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000064c2e455 x1874206984772480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383163.086985:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064c2e455 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984772480:0@lo:400: 00000040:00080000:2.0:1787383163.087581:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1787383163.087654:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787383163.087682:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787383163.087703:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e145 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.087713:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e145 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383163.087790:0:7449:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787383163.087794:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9636183cf000 10000000:01000000:1.0:1787383163.087797:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9636183cf000 10000000:01000000:1.0:1787383163.087801:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787383163.087806:0:7449:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9636183cf000 from 1 10000000:01000000:1.0:1787383163.087809:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787383163.087838:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000b9c919c7/0xc40acec91532e14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.087847:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000b9c919c7/0xc40acec91532e14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.087856:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000b9c919c7/0xc40acec91532e14c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383163.087875:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000396f8de4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984772608:0@lo:101: 00000100:00100000:1.0:1787383163.087926:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787383163.088756:0:6525:0:(import.c:65:import_set_state_nolock()) 00000000e34a966d : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383163.088860:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028ffad0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874206984771712:12345-0@lo:38: Request processed in 15246us (18302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383163.088885:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383163.089249:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787383163.089258:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787383163.089264:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787383163.089269:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787383163.089271:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000c8c5a843 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787383163.089293:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006a001900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984771712:0@lo:38: 00000100:00100000:1.0:1787383163.089461:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000324ff8c9 going to sleep for 11 seconds 00000100:00100000:0.0:1787383163.089507:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d204c949 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984772736:0@lo:41: 00000100:00100000:0.0:1787383163.089540:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383163.089639:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984772736 00000100:00100000:1.0:1787383163.089644:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984772736 00000100:00100000:2.0:1787383163.089686:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984772608 00000100:00100000:1.0:1787383163.089686:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383163.089690:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984772608 00000100:00100000:1.0:1787383163.089693:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3f20f5f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1874206984772736:12345-0@lo:41: 00000004:00000024:1.0:1787383163.089716:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1787383163.089749:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3f20f5f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1874206984772736:12345-0@lo:41: Request processed in 57us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383163.089756:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383163.089809:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d204c949 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984772736:0@lo:41: 00000100:00100000:2.0:1787383163.089815:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787383163.089821:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7f1712c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+14:7449:x1874206984772608:12345-0@lo:101: 00010000:00010000:2.0:1787383163.089830:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383163.089848:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000031635497/0xc40acec91532e153 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e14c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.089868:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000031635497/0xc40acec91532e153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e14c expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.089878:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000031635497/0xc40acec91532e153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e14c expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.089886:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000031635497, rc 0) 00000100:00100000:2.0:1787383163.089934:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7f1712c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:7449:x1874206984772608:12345-0@lo:101: Request processed in 114us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383163.089940:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787383163.090159:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000396f8de4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984772608:0@lo:101: 00010000:00010000:3.0:1787383163.090174:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000b9c919c7/0xc40acec91532e14c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e153 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.090182:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000b9c919c7/0xc40acec91532e14c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e153 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383163.090272:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000072866cf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984772864:0@lo:501: 00000100:00100000:3.0:1787383163.090303:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383163.090333:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000027be40c going to sleep for 11 seconds 00000100:00100000:1.0:1787383163.090388:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984772864 00000100:00100000:1.0:1787383163.090392:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984772864 00000100:00100000:1.0:1787383163.090427:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787383163.090433:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018cd6175 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:7449:x1874206984772864:12345-0@lo:501: 00000100:00100000:1.0:1787383163.090524:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018cd6175 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:7449:x1874206984772864:12345-0@lo:501: Request processed in 91us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383163.090530:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787383163.090628:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000072866cf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984772864:0@lo:501: 00000100:00100000:3.0:1787383163.090653:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000072866cf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984772992:0@lo:503: 00000100:00100000:3.0:1787383163.090690:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383163.090711:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000027be40c going to sleep for 11 seconds 00000100:00100000:2.0:1787383163.090835:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984772992 00000100:00100000:2.0:1787383163.090840:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984772992 00000100:00100000:2.0:1787383163.090867:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787383163.090873:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000138ca5ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:7449:x1874206984772992:12345-0@lo:503: 00000100:00100000:2.0:1787383163.091019:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000138ca5ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:7449:x1874206984772992:12345-0@lo:503: Request processed in 146us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383163.091025:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787383163.091106:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000072866cf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984772992:0@lo:503: 00000040:00080000:3.0:1787383163.091588:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787383163.091666:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000072866cf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984773120:0@lo:502: 00000100:00100000:3.0:1787383163.091706:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383163.091896:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000027be40c going to sleep for 11 seconds 00000100:00100000:0.0:1787383163.092109:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984773120 00000100:00100000:0.0:1787383163.092114:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984773120 00000100:00100000:0.0:1787383163.092141:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787383163.092146:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056daffa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:7449:x1874206984773120:12345-0@lo:502: 00000100:00100000:0.0:1787383163.092243:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056daffa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:7449:x1874206984773120:12345-0@lo:502: Request processed in 96us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383163.092259:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787383163.092343:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000072866cf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984773120:0@lo:502: 00000040:00080000:3.0:1787383163.092520:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787383163.092545:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787383163.092568:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787383163.092581:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787383163.092593:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787383163.092603:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787383163.092613:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787383163.092623:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787383163.092634:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787383163.092644:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787383163.092657:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787383163.092669:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787383163.092682:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787383163.092693:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787383163.092704:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787383163.092716:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787383163.092728:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787383163.092740:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787383163.092751:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787383163.092761:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787383163.092873:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787383163.092887:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787383163.092900:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787383163.092913:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787383163.092923:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787383163.092935:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787383163.092947:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787383163.092958:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1787383163.092982:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000072866cf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984773248:0@lo:502: 00000100:00100000:3.0:1787383163.093127:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383163.093199:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000027be40c going to sleep for 11 seconds 00000100:00100000:2.0:1787383163.093235:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984773248 00000100:00100000:2.0:1787383163.093240:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984773248 00000100:00100000:2.0:1787383163.093311:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787383163.093319:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6a4e909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:7449:x1874206984773248:12345-0@lo:502: 00000100:00100000:2.0:1787383163.093410:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6a4e909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:7449:x1874206984773248:12345-0@lo:502: Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383163.093417:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787383163.093482:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000072866cf1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984773248:0@lo:502: 00000040:00080000:3.0:1787383163.093522:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787383163.093537:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787383163.099362:0:7468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787383163.099379:0:7468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000096cbfeae) 00000020:00000080:3.0:1787383163.099400:0:7468:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787383163.099679:0:7468:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000933e8eca from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787383163.099684:0:7468:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000933e8eca from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787383163.099686:0:7468:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000933e8eca 3 00010000:00080000:3.0:1787383163.099716:0:7468:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000035dce945@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:3.0:1787383163.101371:0:7468:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1787383163.101488:0:7468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787383163.101528:0:7468:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787383163.101541:0:7468:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc40acec91532e161 00000100:00080000:3.0:1787383163.101550:0:7468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787383163.101555:0:7468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000035dce945 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383163.101587:0:7468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000072866cf1 x1874206984773376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787383163.101608:0:7468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787383163.102166:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000072866cf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984773376:0@lo:38: 00000100:00100000:0.0:1787383163.102236:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383163.102298:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984773376 00000100:00100000:0.0:1787383163.102306:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984773376 00000100:00100000:0.0:1787383163.102336:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383163.102342:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077e426fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1874206984773376:12345-0@lo:38: 00010000:00080000:0.0:1787383163.102364:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:0.0:1787383163.102395:0:6521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc40acec91532e168 00000004:00100000:0.0:1787383163.102409:0:6521:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787383163.102438:0:6521:0:(import.c:65:import_set_state_nolock()) 000000005d1b6d8c : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383163.102497:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077e426fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874206984773376:12345-0@lo:38: Request processed in 154us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383163.102505:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787383163.102543:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000072866cf1 x1874206984773376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383163.102552:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787383163.102559:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787383163.102565:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787383163.102569:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787383163.102571:0:3646:0:(import.c:65:import_set_state_nolock()) 0000000035dce945 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787383163.102576:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000072866cf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984773376:0@lo:38: 00000040:00080000:1.0:1787383163.113662:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1787383163.113886:0:7469:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:2.0:1787383163.113967:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787383163.113992:0:7449:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787383163.114018:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000b9c919c7/0xc40acec91532e14c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e153 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.114030:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000b9c919c7/0xc40acec91532e14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e153 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787383163.114095:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787383163.114097:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787383163.114099:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383163.114100:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383163.114105:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383163.114106:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383163.114108:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383163.114109:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787383163.114110:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787383163.114112:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383163.114113:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787383163.114116:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1787383163.114118:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787383163.114119:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787383163.114120:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383163.114121:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383163.114122:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383163.114123:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383163.114123:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383163.114124:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787383163.114125:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787383163.114125:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383163.114126:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787383163.114150:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787383163.114166:0:7449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006f3de8f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984773504:0@lo:253: 00000100:00100000:2.0:1787383163.114230:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383163.114264:0:7449:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd627dc4 going to sleep for 11 seconds 00000100:00100000:1.0:1787383163.114395:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984773504 00000100:00100000:1.0:1787383163.114402:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984773504 00000100:00100000:1.0:1787383163.114447:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787383163.114455:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026340aa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:7449:x1874206984773504:12345-0@lo:253: 20000000:01000000:1.0:1787383163.114480:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787383163.114492:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1787383163.115887:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787383163.116122:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787383163.116140:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1787383163.116290:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787383163.116296:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787383163.116315:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.116333:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002cdd8af8/0xc40acec91532e088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e081 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.116341:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e42e0c21/0xc40acec91532e137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e130 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.116348:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.116396:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e42e0c21/0xc40acec91532e137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e130 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.116410:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e42e0c21/0xc40acec91532e137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e130 expref: 15 pid: 6515 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383163.116422:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000db2e3e14 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984773632:0@lo:104: 00000100:00100000:2.0:1787383163.116479:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383163.116529:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002cdd8af8/0xc40acec91532e088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e081 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.116537:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002cdd8af8/0xc40acec91532e088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e081 expref: 15 pid: 6512 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383163.116545:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c9285bbb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984773760:0@lo:104: 00000100:00100000:2.0:1787383163.116565:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383163.116588:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da5fc556 going to sleep for 11 seconds 00000100:00100000:3.0:1787383163.116639:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984773632 00000100:00100000:3.0:1787383163.116646:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984773632 00000100:00100000:3.0:1787383163.116677:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984773760 00000100:00100000:3.0:1787383163.116681:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984773760 00000100:00100000:3.0:1787383163.116694:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383163.116700:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d6548c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+4:6536:x1874206984773632:12345-0@lo:104: 00010000:00010000:3.0:1787383163.116711:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e137 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.116790:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787383163.116802:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d6548c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+4:6536:x1874206984773632:12345-0@lo:104: Request processed in 102us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383163.116809:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383163.116826:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383163.116832:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d91102b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+3:6536:x1874206984773760:12345-0@lo:104: 00010000:00010000:3.0:1787383163.116838:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e088 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.116868:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787383163.116871:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d91102b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+3:6536:x1874206984773760:12345-0@lo:104: Request processed in 41us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383163.116877:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787383163.116930:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383163.116935:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e137 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.116942:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000063c86932 already unused, calling callback (0000000045fc936d) 10000000:00010000:2.0:1787383163.116945:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e137 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.116952:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e137 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383163.116958:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e137 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383163.116969:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383163.117050:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e137 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.117065:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383163.117080:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e137 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.117089:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e137 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.117101:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383163.117103:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e088 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.117109:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ae08c83f already unused, calling callback (0000000045fc936d) 10000000:00010000:2.0:1787383163.117111:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e088 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.117116:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e088 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383163.117121:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e088 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383163.117125:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383163.117136:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e088 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.117141:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383163.117153:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e088 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.117159:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e088 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.117170:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383163.117171:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383163.117172:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383163.117194:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000db2e3e14 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984773632:0@lo:104: 00000100:00100000:2.0:1787383163.117201:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c9285bbb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984773760:0@lo:104: 00010000:00010000:2.0:1787383163.117217:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383163.117287:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383163.117299:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000018464204 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984773888:0@lo:103: 00000100:00100000:1.0:1787383163.117328:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383163.117358:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383163.117363:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c10d33be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984774016:0@lo:103: 00000100:00100000:1.0:1787383163.117386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383163.117455:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026340aa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:7449:x1874206984773504:12345-0@lo:253: Request processed in 3001us (3225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383163.117463:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787383163.117524:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984773888 00000100:00100000:3.0:1787383163.117528:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984773888 00010000:00010000:3.0:1787383163.117544:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e42e0c21/0xc40acec91532e137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e130 expref: 15 pid: 6515 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383163.117570:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984774016 00000100:00100000:3.0:1787383163.117573:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984774016 00010000:00010000:3.0:1787383163.117583:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002cdd8af8/0xc40acec91532e088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e081 expref: 16 pid: 6512 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383163.117598:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383163.117604:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074cb48d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+16:3647:x1874206984773888:12345-0@lo:103: 00010000:00010000:3.0:1787383163.117613:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383163.117617:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e42e0c21/0xc40acec91532e137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e130 expref: 16 pid: 6515 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117626:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e42e0c21/0xc40acec91532e137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e130 expref: 16 pid: 6515 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117646:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e42e0c21/0xc40acec91532e137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e130 expref: 16 pid: 6515 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117658:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383163.117683:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074cb48d7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+15:3647:x1874206984773888:12345-0@lo:103: Request processed in 80us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383163.117690:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383163.117702:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383163.117708:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d5d55f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+14:3647:x1874206984774016:12345-0@lo:103: 00010000:00010000:3.0:1787383163.117714:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383163.117718:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002cdd8af8/0xc40acec91532e088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e081 expref: 14 pid: 6512 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117726:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002cdd8af8/0xc40acec91532e088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e081 expref: 14 pid: 6512 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117734:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002cdd8af8/0xc40acec91532e088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e081 expref: 14 pid: 6512 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117744:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117751:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787383163.117762:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008434574s 00010000:00010000:3.0:1787383163.117794:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117812:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117818:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117824:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117830:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000112a725b already unused, calling callback (00000000b55119d6) 00010000:00010000:3.0:1787383163.117833:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117840:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117851:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383163.117860:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383163.117881:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d5d55f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+13:3647:x1874206984774016:12345-0@lo:103: Request processed in 174us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383163.117887:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787383163.118876:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.118888:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383163.118894:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000112a725b/0xc40acec91532e16f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383163.118940:0:7449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006f3de8f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:7449:1874206984773504:0@lo:253: 10000000:01000000:2.0:1787383163.118952:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787383163.118955:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787383163.118957:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787383163.118958:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383163.118960:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383163.118961:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383163.118962:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383163.118971:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383163.118972:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787383163.118974:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787383163.118975:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383163.118976:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787383163.119451:0:7449:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787383163.120207:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c10d33be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984774016:0@lo:103: 00000100:00100000:1.0:1787383163.120217:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000018464204 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984773888:0@lo:103: 00080000:10000000:3.0:1787383163.124664:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1787383163.125525:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787383163.125946:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1787383163.126207:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787383163.126416:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787383163.126648:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1787383163.128091:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787383163.128312:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1787383163.128515:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1787383163.128670:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1787383163.128856:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1787383163.129596:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1787383163.131587:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1787383163.131907:0:7474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1787383163.131949:0:7474:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bbb93feb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1874206984774144:0@lo:700: 00000100:00100000:3.0:1787383163.132018:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383163.132047:0:7474:0:(client.c:2702:ptlrpc_set_wait()) set 00000000024f5f8d going to sleep for 11 seconds 00000100:00100000:1.0:1787383163.132156:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984774144 00000100:00100000:1.0:1787383163.132162:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984774144 00000100:00100000:1.0:1787383163.132208:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383163.132214:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff0300c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1874206984774144:12345-0@lo:700: 00000040:01000000:2.0:1787383163.132416:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1787383163.132748:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006f3de8f5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1874206984774272:0@lo:1000: 00000100:00100000:2.0:1787383163.132812:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383163.132884:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set 000000000adac9db going to sleep for 11 seconds 00000040:01000000:3.0:1787383163.133315:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787383163.133461:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787383163.133955:0:7449:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787383163.133963:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787383163.134079:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383163.135033:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787383163.135539:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787383163.135567:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787383163.135736:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787383163.135966:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00080000:0.0:1787383163.136353:0:7473:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787383163.136359:0:7473:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787383163.136444:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984774272 00000100:00100000:1.0:1787383163.136453:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984774272 00000100:00100000:1.0:1787383163.136552:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383163.136560:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9285bbb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1874206984774272:12345-0@lo:1000: 00000100:00100000:1.0:1787383163.136676:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9285bbb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1874206984774272:12345-0@lo:1000: Request processed in 117us (3863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383163.136683:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383163.136861:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006f3de8f5 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1874206984774272:0@lo:1000: 00000040:01000000:0.0:1787383163.136905:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1787383163.136940:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000030507abb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1874206984774400:0@lo:700: 00000100:00100000:0.0:1787383163.136988:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383163.137034:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984774400 00000100:00100000:0.0:1787383163.137038:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984774400 00000100:00100000:0.0:1787383163.137076:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383163.137082:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000744215eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1874206984774400:12345-0@lo:700: 00000100:00100000:0.0:1787383163.137117:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000744215eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1874206984774400:12345-0@lo:700: Request processed in 36us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383163.137122:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383163.137145:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d40ff6dd going to sleep for 11 seconds 00000100:00100000:0.0:1787383163.137157:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000030507abb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1874206984774400:0@lo:700: 00000100:00100000:0.0:1787383163.137195:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000030507abb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1874206984774528:0@lo:900: 00000100:00100000:0.0:1787383163.137217:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383163.137240:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984774528 00000100:00100000:0.0:1787383163.137243:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984774528 00000100:00100000:0.0:1787383163.137267:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383163.137272:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f02a15 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1874206984774528:12345-0@lo:900: 00000100:00100000:0.0:1787383163.137300:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f02a15 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1874206984774528:12345-0@lo:900: Request processed in 28us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383163.137305:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383163.137319:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d40ff6dd going to sleep for 11 seconds 00010000:00080000:0.0:1787383163.137330:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000030507abb x1874206984774528/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787383179 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383163.137339:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000030507abb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1874206984774528:0@lo:900: 00000100:00100000:0.0:1787383163.137403:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000030507abb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1874206984774656:0@lo:1000: 00000100:00100000:0.0:1787383163.137434:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:3.0:1787383163.138085:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787383163.138238:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787383163.138369:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787383163.138497:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787383163.138644:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787383163.139045:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787383163.139159:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787383163.139261:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000100:00100000:2.0:1787383163.139517:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984774656 00000100:00100000:2.0:1787383163.139527:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984774656 00000100:00100000:1.0:1787383163.139560:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383163.139570:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f391043 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1874206984774656:12345-0@lo:1000: 00100000:10000000:3.0:1787383163.139582:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000100:00100000:1.0:1787383163.139659:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f391043 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1874206984774656:12345-0@lo:1000: Request processed in 90us (2225us total) trans 0 rc 0/0 00100000:10000000:3.0:1787383163.139713:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787383163.139876:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787383163.140070:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787383163.140194:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787383163.140300:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787383163.140421:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787383163.140527:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787383163.140954:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787383163.141107:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787383163.141247:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787383163.141448:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787383163.141581:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787383163.141681:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787383163.141900:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000100:00100000:0.0:1787383163.142132:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set 00000000971d395b going to sleep for 11 seconds 00000100:00100000:1.0:1787383163.142164:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383163.142165:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000030507abb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1874206984774656:0@lo:1000: 00000004:00080000:0.0:1787383163.142223:0:7475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d40ff6dd with version 0 00000020:00100000:0.0:1787383163.142246:0:7475:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787383163.142252:0:7475:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000030507abb x1874206984774912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383163.142270:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000030507abb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1874206984774912:0@lo:1000: 00000100:00100000:0.0:1787383163.142317:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383163.142344:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f5e58836 going to sleep for 11 seconds 00100000:10000000:3.0:1787383163.142416:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000100:00100000:2.0:1787383163.142521:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984774912 00000100:00100000:2.0:1787383163.142528:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984774912 00100000:10000000:3.0:1787383163.142558:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000100:00100000:2.0:1787383163.142569:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787383163.142582:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbe8c536 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1874206984774912:12345-0@lo:1000: 00100000:10000000:3.0:1787383163.142682:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787383163.143380:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787383163.143532:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787383163.143665:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 40000000:02000000:2.0:1787383163.143864:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:3.0:1787383163.143928:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787383163.144106:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787383163.144257:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787383163.144457:0:7449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1787383163.148895:0:7449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787383163.148933:0:7449:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb73d818f7988 00100000:10000000:3.0:1787383163.148943:0:7449:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000001:00080000:1.0:1787383163.154330:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1787383163.154492:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbe8c536 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1874206984774912:12345-0@lo:1000: Request processed in 11913us (12170us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787383163.154508:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1787383163.154592:0:7475:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787383163.154597:0:7475:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787383163.154611:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000030507abb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1874206984774912:0@lo:1000: 00000100:00100000:1.0:1787383163.154702:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000055074f8d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1874206984775040:0@lo:1000: 00000100:00100000:1.0:1787383163.154740:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383163.154848:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984775040 00000100:00100000:0.0:1787383163.154854:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984775040 00000100:00100000:0.0:1787383163.154892:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383163.154900:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081301705 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1874206984775040:12345-0@lo:1000: 00000100:00100000:0.0:1787383163.154957:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081301705 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1874206984775040:12345-0@lo:1000: Request processed in 59us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383163.154964:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383163.155116:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set 000000005e3006c2 going to sleep for 11 seconds 00000100:00100000:1.0:1787383163.155133:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000055074f8d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1874206984775040:0@lo:1000: 00000040:00080000:1.0:1787383163.155148:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787383163.155175:0:7475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002ddc5723 with version 1 00000020:01000004:3.0:1787383163.155300:0:7449:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787383163.155328:0:7449:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787383163.155350:0:7449:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787383163.155370:0:7449:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787383163.156159:0:7449:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787383163.156344:0:7449:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1787383163.156975:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff0300c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1874206984774144:12345-0@lo:700: Request processed in 24758us (24954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383163.156989:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787383163.157032:0:7474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bbb93feb x1874206984774144/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787383179 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383163.157044:0:7474:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bbb93feb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1874206984774144:0@lo:700: 40000000:02000000:3.0:1787383163.157066:0:7474:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000040:00080000:1.0:1787383163.165496:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787383163.165569:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787383163.169532:0:7465:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000becfb261 version 1 rpc_version 1 00000020:00100000:2.0:1787383163.169576:0:7465:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787383163.169760:0:7465:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000db2e3e14 x1874206984775296/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383163.169821:0:7465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000db2e3e14 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1874206984775296:0@lo:1000: 00000100:00100000:2.0:1787383163.169885:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383163.169938:0:7465:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c259117b going to sleep for 11 seconds 00000100:00100000:0.0:1787383163.169962:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984775296 00000100:00100000:0.0:1787383163.169969:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984775296 00000100:00100000:0.0:1787383163.170025:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787383163.170033:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030a4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1874206984775296:12345-0@lo:1000: 00000001:00080000:1.0:1787383163.177231:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1787383163.177390:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030a4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7465:x1874206984775296:12345-0@lo:1000: Request processed in 7353us (7501us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787383163.177404:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1787383163.177517:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1787383163.177522:0:7465:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787383163.177538:0:7465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000db2e3e14 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1874206984775296:0@lo:1000: 00000040:00080000:0.0:1787383163.200268:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383163.204339:0:7474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787383163.204430:0:7474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787383163.204435:0:7474:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1787383163.547937:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383164.575150:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383165.603333:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383166.621804:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787383167.406021:0:7720:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787383167.642941:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383168.155427:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bbb93feb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984775424:0@lo:41: 00000100:00100000:1.0:1787383168.155523:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383168.156121:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000270a119e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984775680:0@lo:400: 00000100:00100000:2.0:1787383168.156175:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383168.156205:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383168.156211:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fadb02f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984775808:0@lo:400: 00000100:00100000:2.0:1787383168.156238:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383168.156280:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984775680 00000100:00100000:2.0:1787383168.156289:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984775680 00000100:00100000:2.0:1787383168.156342:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984775808 00000100:00100000:2.0:1787383168.156345:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984775808 00000100:00100000:2.0:1787383168.156361:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383168.156368:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f3de8f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984775680:12345-0@lo:400: 00000100:00100000:2.0:1787383168.156425:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f3de8f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984775680:12345-0@lo:400: Request processed in 57us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383168.156434:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383168.156454:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787383168.156460:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018464204 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984775808:12345-0@lo:400: 00000100:00100000:2.0:1787383168.156487:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018464204 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984775808:12345-0@lo:400: Request processed in 28us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383168.156494:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787383168.156527:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fadb02f4 x1874206984775808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383168.156542:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fadb02f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984775808:0@lo:400: 00010000:00080000:2.0:1787383168.156553:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000270a119e x1874206984775680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383168.156574:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000270a119e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984775680:0@lo:400: 00000100:00100000:2.0:1787383168.156597:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383168.156604:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000db2e3e14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984775552:0@lo:400: 00000100:00100000:2.0:1787383168.156647:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383168.156679:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984775552 00000100:00100000:2.0:1787383168.156682:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984775552 00000100:00100000:2.0:1787383168.156709:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787383168.156715:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f6980d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+13:3649:x1874206984775552:12345-0@lo:400: 00000100:00100000:3.0:1787383168.157265:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984775424 00000100:00100000:3.0:1787383168.157273:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984775424 00000100:00100000:3.0:1787383168.157319:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383168.157327:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055074f8d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984775424:12345-0@lo:41: 00000004:00000024:3.0:1787383168.157365:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787383168.157418:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055074f8d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984775424:12345-0@lo:41: Request processed in 93us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383168.157425:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383168.157470:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bbb93feb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984775424:0@lo:41: 00000100:00100000:0.0:1787383168.162093:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f6980d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+13:3649:x1874206984775552:12345-0@lo:400: Request processed in 5363us (5431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383168.162115:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787383168.162290:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000db2e3e14 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984775552:0@lo:400: 00000020:00000004:3.0:1787383168.401140:0:7772:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787383168.401342:0:7772:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787383168.668182:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383169.691247:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383170.715055:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787383171.162499:0:7873:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383171.162729:0:7873:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787383171.228045:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787383171.228053:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9636183cf000 from 4 10000000:01000000:2.0:1787383171.228058:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787383171.228112:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000142d1f44/0xc40acec91532e176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383171.228125:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000142d1f44/0xc40acec91532e176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383171.228137:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000142d1f44/0xc40acec91532e176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383171.228161:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000270a119e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984775936:0@lo:101: 00000100:00100000:2.0:1787383171.228229:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383171.228284:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 0000000045470978 going to sleep for 11 seconds 00000100:00100000:1.0:1787383171.228372:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984775936 00000100:00100000:1.0:1787383171.228381:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984775936 00000100:00100000:1.0:1787383171.228450:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787383171.228459:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c484ac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+13:6517:x1874206984775936:12345-0@lo:101: 00010000:00010000:1.0:1787383171.228473:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383171.228486:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f50e5a5/0xc40acec91532e17d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e176 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383171.228508:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f50e5a5/0xc40acec91532e17d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e176 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383171.228517:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f50e5a5/0xc40acec91532e17d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e176 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383171.228526:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f50e5a5, rc 0) 00000100:00100000:1.0:1787383171.228563:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c484ac2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+14:6517:x1874206984775936:12345-0@lo:101: Request processed in 106us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383171.228571:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787383171.229096:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000270a119e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984775936:0@lo:101: 00010000:00010000:2.0:1787383171.229112:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000142d1f44/0xc40acec91532e176 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e17d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383171.229120:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000142d1f44/0xc40acec91532e176 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e17d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383171.229199:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000270a119e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984776064:0@lo:256: 00000100:00100000:2.0:1787383171.229242:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383171.229280:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 0000000045470978 going to sleep for 11 seconds 00000100:00100000:1.0:1787383171.229369:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984776064 00000100:00100000:1.0:1787383171.229374:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984776064 00000100:00100000:1.0:1787383171.229423:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383171.229431:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085e8b0fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+14:6517:x1874206984776064:12345-0@lo:256: 20000000:01000000:1.0:1787383171.229617:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787383171.229633:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787383171.229636:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787383171.229878:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085e8b0fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+14:6517:x1874206984776064:12345-0@lo:256: Request processed in 449us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383171.229887:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787383171.229967:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000270a119e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984776064:0@lo:256: 10000000:01000000:3.0:1787383171.230023:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787383171.230031:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 00000000142d1f44/0xc40acec91532e176 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e17d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383171.230039:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 00000000142d1f44/0xc40acec91532e176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e17d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383171.230048:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787383171.230050:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9636064d1800 from 21 10000000:01000000:3.0:1787383171.230052:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787383171.230074:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383171.230081:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383171.230088:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383171.230102:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bbb93feb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984776192:0@lo:101: 00000100:00100000:3.0:1787383171.230131:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383171.230282:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984776192 00000100:00100000:2.0:1787383171.230287:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984776192 00000100:00100000:2.0:1787383171.230320:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787383171.230326:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000096955e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+14:6517:x1874206984776192:12345-0@lo:101: 00010000:00010000:2.0:1787383171.230335:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383171.230344:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000112a725b/0xc40acec91532e18b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e184 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383171.230361:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000112a725b/0xc40acec91532e18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e184 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383171.230369:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000112a725b/0xc40acec91532e18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e184 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383171.230377:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000112a725b, rc 0) 00000100:00100000:2.0:1787383171.230401:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000096955e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984776192:12345-0@lo:101: Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383171.230407:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787383171.230514:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e3da697a going to sleep for 11 seconds 00000100:00100000:3.0:1787383171.230528:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bbb93feb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984776192:0@lo:101: 00010000:00010000:3.0:1787383171.230537:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e18b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383171.230543:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e18b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383171.230598:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bbb93feb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984776320:0@lo:501: 00000100:00100000:3.0:1787383171.230624:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383171.230644:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e3da697a going to sleep for 11 seconds 00000100:00100000:2.0:1787383171.230686:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984776320 00000100:00100000:2.0:1787383171.230690:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984776320 00000100:00100000:2.0:1787383171.230715:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787383171.230720:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063cb192c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984776320:12345-0@lo:501: 00000100:00100000:2.0:1787383171.230845:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063cb192c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984776320:12345-0@lo:501: Request processed in 125us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383171.230859:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787383171.231011:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bbb93feb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984776320:0@lo:501: 00000100:00100000:2.0:1787383171.231035:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fadb02f4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984776448:0@lo:503: 00000100:00100000:2.0:1787383171.231069:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383171.231086:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 000000000b8f663c going to sleep for 11 seconds 00000100:00100000:2.0:1787383171.231095:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984776448 00000100:00100000:2.0:1787383171.231098:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984776448 00000100:00100000:2.0:1787383171.231113:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787383171.231118:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1175c20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984776448:12345-0@lo:503: 00000100:00100000:2.0:1787383171.231333:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1175c20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984776448:12345-0@lo:503: Request processed in 215us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383171.231340:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787383171.231377:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fadb02f4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984776448:0@lo:503: 00000100:00100000:2.0:1787383171.231532:0:7879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fadb02f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:7879:1874206984776576:0@lo:502: 00000100:00100000:2.0:1787383171.231562:0:7879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383171.231578:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984776576 00000100:00100000:2.0:1787383171.231581:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984776576 00000100:00100000:2.0:1787383171.231599:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787383171.231606:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033239cfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:7879:x1874206984776576:12345-0@lo:502: 00000100:00100000:2.0:1787383171.231687:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033239cfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:7879:x1874206984776576:12345-0@lo:502: Request processed in 83us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383171.231693:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787383171.231714:0:7879:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d40e3897 going to sleep for 11 seconds 00000100:00100000:2.0:1787383171.231723:0:7879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fadb02f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:7879:1874206984776576:0@lo:502: 00000100:00100000:2.0:1787383171.231753:0:7879:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fadb02f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:7879:1874206984776704:0@lo:502: 00000100:00100000:2.0:1787383171.231805:0:7879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383171.231820:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984776704 00000100:00100000:2.0:1787383171.231822:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984776704 00000100:00100000:2.0:1787383171.231835:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787383171.231839:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f12086c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:7879:x1874206984776704:12345-0@lo:502: 00000100:00100000:2.0:1787383171.231883:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f12086c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:7879:x1874206984776704:12345-0@lo:502: Request processed in 44us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383171.231889:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787383171.231908:0:7879:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a97260a7 going to sleep for 11 seconds 00000100:00100000:2.0:1787383171.231917:0:7879:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fadb02f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:7879:1874206984776704:0@lo:502: 00000040:00080000:2.0:1787383171.231932:0:7879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787383171.235869:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787383171.235905:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787383171.235915:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e18b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383171.235929:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 000000002cdd8af8/0xc40acec91532e184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e18b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383171.235939:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787383171.235941:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9636064d1800 from 4 10000000:01000000:3.0:1787383171.235944:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787383171.235980:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 000000001e31b953/0xc40acec91532e192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383171.235988:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 000000001e31b953/0xc40acec91532e192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383171.236008:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 000000001e31b953/0xc40acec91532e192 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383171.236032:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000daee4e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984776832:0@lo:101: 00000100:00100000:3.0:1787383171.236100:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383171.236150:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 000000004fa5e0ef going to sleep for 11 seconds 00000100:00100000:2.0:1787383171.236230:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984776832 00000100:00100000:2.0:1787383171.236239:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984776832 00000100:00100000:2.0:1787383171.236296:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787383171.236304:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000674701f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984776832:12345-0@lo:101: 00010000:00010000:2.0:1787383171.236316:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383171.236326:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e42e0c21/0xc40acec91532e199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e192 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383171.236349:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e42e0c21/0xc40acec91532e199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e192 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383171.236357:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e42e0c21/0xc40acec91532e199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e192 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383171.236365:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e42e0c21, rc 0) 00000100:00100000:2.0:1787383171.236418:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000674701f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984776832:12345-0@lo:101: Request processed in 114us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383171.236435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787383171.237524:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000daee4e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984776832:0@lo:101: 00010000:00010000:1.0:1787383171.237546:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 000000001e31b953/0xc40acec91532e192 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e199 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383171.237557:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 000000001e31b953/0xc40acec91532e192 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e199 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383171.237614:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075b87030 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984776960:0@lo:256: 00000100:00100000:1.0:1787383171.237665:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383171.237703:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5508126 going to sleep for 11 seconds 00000100:00100000:0.0:1787383171.238205:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984776960 00000100:00100000:0.0:1787383171.238213:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984776960 00000100:00100000:0.0:1787383171.238251:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383171.238258:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032889f69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984776960:12345-0@lo:256: 20000000:01000000:0.0:1787383171.238278:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787383171.238298:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787383171.238302:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787383171.238398:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032889f69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984776960:12345-0@lo:256: Request processed in 140us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383171.238407:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787383171.238496:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075b87030 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984776960:0@lo:256: 10000000:01000000:1.0:1787383171.238546:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787383171.238553:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 000000001e31b953/0xc40acec91532e192 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e199 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383171.238562:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 000000001e31b953/0xc40acec91532e192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e199 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383171.238571:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787383171.238573:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787383171.238576:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787383171.238599:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e1a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383171.238613:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e1a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383171.238622:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e1a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383171.238637:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000075b87030 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984777088:0@lo:101: 00000100:00100000:1.0:1787383171.238668:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383171.238819:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5508126 going to sleep for 11 seconds 00000100:00100000:0.0:1787383171.239411:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984777088 00000100:00100000:0.0:1787383171.239417:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984777088 00000100:00100000:0.0:1787383171.239449:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787383171.239455:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a38d827 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984777088:12345-0@lo:101: 00010000:00010000:0.0:1787383171.239466:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383171.239478:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e63f6b5e/0xc40acec91532e1a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e1a0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383171.239499:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e63f6b5e/0xc40acec91532e1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e1a0 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383171.239516:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e63f6b5e/0xc40acec91532e1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e1a0 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383171.239525:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e63f6b5e, rc 0) 00000100:00100000:0.0:1787383171.239578:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a38d827 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984777088:12345-0@lo:101: Request processed in 122us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383171.239585:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787383171.239854:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000075b87030 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984777088:0@lo:101: 00010000:00010000:3.0:1787383171.239869:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e1a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e1a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383171.239893:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e1a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e1a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383171.239962:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008e346f06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984777216:0@lo:501: 00000100:00100000:3.0:1787383171.239991:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383171.240094:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 000000009bfac4e8 going to sleep for 11 seconds 00000100:00100000:1.0:1787383171.241342:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984777216 00000100:00100000:1.0:1787383171.241354:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984777216 00000100:00100000:1.0:1787383171.241396:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787383171.241404:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021783ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984777216:12345-0@lo:501: 00000100:00100000:1.0:1787383171.241553:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021783ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984777216:12345-0@lo:501: Request processed in 149us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383171.241562:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787383171.241611:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008e346f06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984777216:0@lo:501: 00000100:00100000:1.0:1787383171.241651:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000703b3066 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984777344:0@lo:503: 00000100:00100000:1.0:1787383171.241697:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383171.241715:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dcb7fde going to sleep for 11 seconds 00000100:00100000:1.0:1787383171.241729:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984777344 00000100:00100000:1.0:1787383171.241732:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984777344 00000100:00100000:1.0:1787383171.241754:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787383171.241759:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002722b806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984777344:12345-0@lo:503: 00000100:00100000:1.0:1787383171.241846:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002722b806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984777344:12345-0@lo:503: Request processed in 86us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383171.241862:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787383171.241902:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000703b3066 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984777344:0@lo:503: 00000100:00100000:1.0:1787383171.242082:0:7881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000703b3066 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:7881:1874206984777472:0@lo:502: 00000100:00100000:1.0:1787383171.242116:0:7881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383171.242133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984777472 00000100:00100000:1.0:1787383171.242136:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984777472 00000100:00100000:1.0:1787383171.242157:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787383171.242162:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000faee86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:7881:x1874206984777472:12345-0@lo:502: 00000100:00100000:1.0:1787383171.242226:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000faee86b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:7881:x1874206984777472:12345-0@lo:502: Request processed in 63us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383171.242232:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787383171.242258:0:7881:0:(client.c:2702:ptlrpc_set_wait()) set 000000001a0874a3 going to sleep for 11 seconds 00000100:00100000:1.0:1787383171.242268:0:7881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000703b3066 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:7881:1874206984777472:0@lo:502: 00000020:01000000:1.0:1787383171.242286:0:7881:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383171.242295:0:7881:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383171.242297:0:7881:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787383171.242302:0:7881:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787383171.242306:0:7881:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:00000080:1.0:1787383171.242325:0:7881:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787383171.242338:0:7881:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000c9501f92) 00000020:00000080:1.0:1787383171.242356:0:7881:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1787383171.242361:0:7881:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787383171.242447:0:7881:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787383171.242452:0:7881:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787383171.242458:0:7881:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532e1b5 00010000:00080000:1.0:1787383171.242484:0:7881:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000080e322a9@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1787383171.244118:0:7881:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1787383171.258673:0:7881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787383171.258688:0:7881:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787383171.258727:0:7881:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787383171.258750:0:7881:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532e1bc 00000100:00080000:2.0:1787383171.258759:0:7881:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383171.258792:0:7881:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000080e322a9 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383171.258827:0:7881:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fadb02f4 x1874206984777600/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383171.258857:0:7881:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787383171.259256:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fadb02f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984777600:0@lo:38: 00000100:00100000:0.0:1787383171.259323:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383171.259619:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086e6ceec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984777728:0@lo:400: 00000100:00100000:3.0:1787383171.259654:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383171.259853:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984777728 00000100:00100000:0.0:1787383171.259860:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984777728 00000100:00100000:0.0:1787383171.259913:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383171.259921:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e346f06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984777728:12345-0@lo:400: 00000100:00100000:0.0:1787383171.259967:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e346f06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984777728:12345-0@lo:400: Request processed in 47us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383171.259973:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:01000000:2.0:1787383171.261116:0:7881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00010000:00080000:3.0:1787383171.261572:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000086e6ceec x1874206984777728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383171.261587:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086e6ceec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984777728:0@lo:400: 00000100:00100000:3.0:1787383171.261606:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383171.261614:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ddadbdb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984777856:0@lo:400: 00000100:00100000:3.0:1787383171.261652:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383171.261690:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383171.261698:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fffe03ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984777984:0@lo:400: 00000100:00100000:3.0:1787383171.261722:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383171.261758:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984777600 00000100:00100000:3.0:1787383171.261762:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984777600 00000100:00100000:3.0:1787383171.261801:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984777856 00000100:00100000:3.0:1787383171.261803:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984777856 00000100:00100000:3.0:1787383171.261827:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383171.261833:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbe7c9e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206984777600:12345-0@lo:38: 00010000:00080000:3.0:1787383171.261858:0:6525:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000100:00080000:0.0:1787383171.263213:0:7886:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000eb6437f9 x1874206984778112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383171.263226:0:7886:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bb46b446 going to sleep for 0 seconds 00000020:00000080:3.0:1787383171.263257:0:6525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532e1c3 00000004:00100000:3.0:1787383171.263281:0:6525:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787383171.263287:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:2.0:1787383171.264314:0:7881:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383171.264324:0:7881:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383171.264337:0:7881:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787383171.264341:0:7881:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383171.264345:0:7881:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383171.264347:0:7881:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787383171.264350:0:7881:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787383171.264351:0:7881:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787383171.264392:0:7881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c10d33be pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:7881:1874206984778240:0@lo:502: 00000100:00100000:2.0:1787383171.264538:0:7881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383171.264579:0:7881:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d40ff6dd going to sleep for 11 seconds 00000100:00100000:3.0:1787383171.264697:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984777984 00000100:00100000:3.0:1787383171.264704:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984777984 00000100:00100000:3.0:1787383171.264749:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383171.264757:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000daee4e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984777984:12345-0@lo:400: 00000100:00100000:3.0:1787383171.264830:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000daee4e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984777984:12345-0@lo:400: Request processed in 73us (3107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383171.264837:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787383171.264875:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fffe03ed x1874206984777984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383171.264899:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fffe03ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984777984:0@lo:400: 00000100:00100000:0.0:1787383171.267029:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984778240 00000100:00100000:0.0:1787383171.267043:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984778240 00000100:00100000:0.0:1787383171.267098:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787383171.267107:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c25ed8ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:7881:x1874206984778240:12345-0@lo:502: 00000100:00100000:0.0:1787383171.267557:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c25ed8ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:7881:x1874206984778240:12345-0@lo:502: Request processed in 451us (3018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383171.267566:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787383171.271637:0:7881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c10d33be pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:7881:1874206984778240:0@lo:502: 00000020:01000000:0.0:1787383171.273065:0:7881:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383171.273076:0:7881:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383171.273079:0:7881:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787383171.273087:0:7881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787383171.273238:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787383171.273261:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787383171.273270:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e1a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e1a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383171.273281:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 0000000063c86932/0xc40acec91532e1a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e1a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383171.273291:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787383171.273293:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9636345a8000 from 1 10000000:01000000:1.0:1787383171.273296:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787383171.273340:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 000000008aceb106/0xc40acec91532e1ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383171.273348:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 000000008aceb106/0xc40acec91532e1ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383171.273356:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 000000008aceb106/0xc40acec91532e1ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383171.273762:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000703b3066 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984778368:0@lo:101: 00000100:00100000:1.0:1787383171.273851:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383171.274019:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f03a1e43 going to sleep for 11 seconds 00000100:00100000:0.0:1787383171.274156:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984778368 00000100:00100000:0.0:1787383171.274165:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984778368 00000100:00100000:0.0:1787383171.274210:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787383171.274217:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028d854b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984778368:12345-0@lo:101: 00010000:00010000:0.0:1787383171.274230:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383171.274241:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f3951b8/0xc40acec91532e1d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e1ca expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383171.274277:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f3951b8/0xc40acec91532e1d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e1ca expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383171.274287:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f3951b8/0xc40acec91532e1d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e1ca expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383171.274295:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f3951b8, rc 0) 00000100:00100000:0.0:1787383171.274336:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028d854b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984778368:12345-0@lo:101: Request processed in 120us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383171.274343:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787383171.274389:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000703b3066 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984778368:0@lo:101: 00010000:00010000:0.0:1787383171.274401:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 000000008aceb106/0xc40acec91532e1ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e1d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383171.274409:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 000000008aceb106/0xc40acec91532e1ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e1d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383171.274467:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e5aceb4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984778496:0@lo:501: 00000100:00100000:0.0:1787383171.274508:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383171.274529:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c652401a going to sleep for 11 seconds 00000100:00100000:0.0:1787383171.274540:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984778496 00000100:00100000:0.0:1787383171.274543:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984778496 00000100:00100000:0.0:1787383171.274564:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787383171.274568:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e16df31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984778496:12345-0@lo:501: 00000100:00100000:0.0:1787383171.274636:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e16df31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984778496:12345-0@lo:501: Request processed in 67us (127us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787383171.274643:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787383171.274672:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e5aceb4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984778496:0@lo:501: 10000000:01000000:0.0:1787383171.274692:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787383171.274697:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: 000000008aceb106/0xc40acec91532e1ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e1d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383171.274704:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: 000000008aceb106/0xc40acec91532e1ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e1d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787383171.278849:0:6525:0:(import.c:65:import_set_state_nolock()) 000000005db7e3f8 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383171.278951:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbe7c9e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874206984777600:12345-0@lo:38: Request processed in 17104us (19616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383171.278961:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787383171.279007:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787383171.279018:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086e6ceec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984777856:12345-0@lo:400: 00000100:00100000:1.0:1787383171.279063:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086e6ceec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984777856:12345-0@lo:400: Request processed in 49us (17411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383171.279075:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787383171.279120:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ddadbdb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984777856:0@lo:400: 00000100:00100000:0.0:1787383171.279252:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787383171.279259:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787383171.279267:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787383171.279271:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787383171.279273:0:3646:0:(import.c:65:import_set_state_nolock()) 0000000080e322a9 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787383171.279295:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000bb46b446): req@00000000eb6437f9 x1874206984778112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383171.279324:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fadb02f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984777600:0@lo:38: 00000100:00100000:2.0:1787383171.279512:0:7886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383171.279551:0:7886:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bb46b446 going to sleep for 11 seconds 00000100:00100000:0.0:1787383171.279601:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984778112 00000100:00100000:0.0:1787383171.279614:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984778112 00000100:00100000:0.0:1787383171.279657:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787383171.279663:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c10d33be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7886:x1874206984778112:12345-0@lo:1000: 00000100:00100000:0.0:1787383171.279724:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c10d33be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7886:x1874206984778112:12345-0@lo:1000: Request processed in 61us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383171.279730:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787383171.279812:0:7886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eb6437f9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7886:1874206984778112:0@lo:1000: 00000100:00100000:0.0:1787383171.285100:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000789ed15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984778624:0@lo:41: 00000040:01000000:2.0:1787383171.285141:0:7886:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787383171.285174:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383171.285194:0:7886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dac5660e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7886:1874206984778752:0@lo:1000: 00000100:00100000:2.0:1787383171.285245:0:7886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383171.285246:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984778624 00000100:00100000:2.0:1787383171.285275:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984778752 00000100:00100000:2.0:1787383171.285282:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984778752 00000100:00100000:2.0:1787383171.285317:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383171.285322:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f361dc51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7886:x1874206984778752:12345-0@lo:1000: 00000100:00100000:0.0:1787383171.285327:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984778624 00000100:00100000:2.0:1787383171.287121:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f361dc51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7886:x1874206984778752:12345-0@lo:1000: Request processed in 1793us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383171.287134:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383171.287177:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383171.287185:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5aceb4d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984778624:12345-0@lo:41: 00000004:00000024:2.0:1787383171.287211:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787383171.287252:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5aceb4d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984778624:12345-0@lo:41: Request processed in 70us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383171.287258:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383171.287289:0:7886:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075482bfc going to sleep for 11 seconds 00000100:00100000:2.0:1787383171.287307:0:7886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dac5660e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7886:1874206984778752:0@lo:1000: 00000100:00100000:0.0:1787383171.287353:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000789ed15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984778624:0@lo:41: 00000100:00100000:2.0:1787383171.287560:0:7886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dac5660e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7886:1874206984778880:0@lo:700: 00000100:00100000:2.0:1787383171.287588:0:7886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383171.287614:0:7886:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d9ff375f going to sleep for 11 seconds 00000100:00100000:0.0:1787383171.288137:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984778880 00000100:00100000:0.0:1787383171.288144:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984778880 00000100:00100000:0.0:1787383171.288179:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383171.288185:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c36b7af0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7886:x1874206984778880:12345-0@lo:700: 00000100:00100000:0.0:1787383171.288234:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c36b7af0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7886:x1874206984778880:12345-0@lo:700: Request processed in 49us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383171.288241:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383171.288803:0:7886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dac5660e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7886:1874206984778880:0@lo:700: 00000100:00100000:2.0:1787383171.289023:0:7886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dac5660e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7886:1874206984779008:0@lo:1000: 00000100:00100000:2.0:1787383171.289058:0:7886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383171.289085:0:7886:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b9b51818 going to sleep for 11 seconds 00000100:00100000:0.0:1787383171.289124:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984779008 00000100:00100000:0.0:1787383171.289131:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984779008 00000100:00100000:0.0:1787383171.289164:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787383171.289170:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029e87ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7886:x1874206984779008:12345-0@lo:1000: 00000100:00100000:0.0:1787383171.289248:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029e87ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7886:x1874206984779008:12345-0@lo:1000: Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383171.289255:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787383171.289549:0:7886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dac5660e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7886:1874206984779008:0@lo:1000: 00000004:00080000:3.0:1787383171.289591:0:7886:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000d9ff375f with version 0 00000020:00100000:3.0:1787383171.289606:0:7886:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787383171.289612:0:7886:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000fffe03ed x1874206984779264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787383171.289625:0:7886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fffe03ed pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7886:1874206984779264:0@lo:1000: 00000100:00100000:3.0:1787383171.289652:0:7886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383171.289685:0:7886:0:(client.c:2702:ptlrpc_set_wait()) set 000000009bfac4e8 going to sleep for 11 seconds 00000100:00100000:0.0:1787383171.290015:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984779264 00000100:00100000:0.0:1787383171.290021:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984779264 00000100:00100000:0.0:1787383171.290045:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383171.290058:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbb93feb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7886:x1874206984779264:12345-0@lo:1000: 00000001:00080000:0.0:1787383171.296581:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1787383171.296594:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787383171.296829:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbb93feb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7886:x1874206984779264:12345-0@lo:1000: Request processed in 6768us (7173us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787383171.296842:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1787383171.297007:0:7886:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1787383171.297012:0:7886:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787383171.297029:0:7886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fffe03ed pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7886:1874206984779264:0@lo:1000: 00000100:00100000:0.0:1787383171.297114:0:7886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eb6437f9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7886:1874206984779392:0@lo:1000: 00000100:00100000:0.0:1787383171.297151:0:7886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383171.297173:0:7886:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d1f715c6 going to sleep for 11 seconds 00000100:00100000:2.0:1787383171.298574:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984779392 00000100:00100000:2.0:1787383171.298587:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984779392 00000100:00100000:2.0:1787383171.298686:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383171.298705:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030507abb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7886:x1874206984779392:12345-0@lo:1000: 00000100:00100000:2.0:1787383171.298841:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030507abb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7886:x1874206984779392:12345-0@lo:1000: Request processed in 140us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383171.298850:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383171.298959:0:7886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eb6437f9 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7886:1874206984779392:0@lo:1000: 00000040:00080000:0.0:1787383171.298984:0:7886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787383171.299028:0:7886:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000087f183a9 with version 1 00000040:00080000:0.0:1787383171.301645:0:7886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787383171.301659:0:7882:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000001a0874a3 version 1 rpc_version 1 00000020:00100000:1.0:1787383171.301695:0:7882:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787383171.301704:0:7882:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006cc1bcc1 x1874206984779648/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383171.301726:0:7882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006cc1bcc1 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7882:1874206984779648:0@lo:1000: 00000004:00080000:0.0:1787383171.301732:0:7886:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787383171.301737:0:7886:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1787383171.301812:0:7882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383171.301841:0:7882:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f03a1e43 going to sleep for 11 seconds 00000100:00100000:1.0:1787383171.301865:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984779648 00000100:00100000:1.0:1787383171.301871:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984779648 00000100:00100000:1.0:1787383171.301986:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787383171.301995:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f8e8b4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7882:x1874206984779648:12345-0@lo:1000: 00000001:00080000:1.0:1787383171.303462:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1787383171.303678:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f8e8b4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7882:x1874206984779648:12345-0@lo:1000: Request processed in 1682us (1865us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787383171.303691:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1787383171.303919:0:7882:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1787383171.303924:0:7882:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787383171.303995:0:7882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006cc1bcc1 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7882:1874206984779648:0@lo:1000: 00010000:00010000:3.0:1787383171.742863:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787383172.208363:0:7927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffcdc456970 00000020:00000080:3.0:1787383172.208379:0:7927:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787383172.208384:0:7927:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787383172.208393:0:7927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcdc458c00 20000000:00000080:3.0:1787383172.208400:0:7927:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96363d8fe400 uarg=0000000000000000 20000000:01000000:3.0:1787383172.208438:0:7927:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787383172.208450:0:7927:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787383172.208455:0:7927:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787383172.208537:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787383172.208550:0:7927:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787383172.214171:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383172.214508:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787383172.214538:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787383172.214551:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787383172.214567:0:7927:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787383172.214582:0:7927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383172.214599:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e522f6d0/0xc40acec91532e057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e050 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383172.214606:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003fe1653a/0xc40acec91532e145 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e13e expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383172.214612:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383172.214644:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003fe1653a/0xc40acec91532e145 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e13e expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383172.214655:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003fe1653a/0xc40acec91532e145 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e13e expref: 17 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383172.214667:0:7927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000072866cf1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874206984779776:0@lo:104: 00000100:00100000:3.0:1787383172.214813:0:7927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787383172.214923:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e522f6d0/0xc40acec91532e057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e050 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383172.214948:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e522f6d0/0xc40acec91532e057 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e050 expref: 17 pid: 6515 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383172.214956:0:7927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d204c949 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874206984779904:0@lo:104: 00000100:00100000:3.0:1787383172.214974:0:7927:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e3da697a going to sleep for 11 seconds 00000100:00100000:1.0:1787383172.215169:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787383172.215186:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383172.215243:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984779776 00000100:00100000:1.0:1787383172.215250:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984779776 00000100:00100000:2.0:1787383172.215301:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984779904 00000100:00100000:2.0:1787383172.215305:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984779904 00000100:00100000:2.0:1787383172.215325:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787383172.215332:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bdf5146 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+4:7927:x1874206984779776:12345-0@lo:104: 00010000:00010000:2.0:1787383172.215342:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e145 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.215398:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787383172.215402:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bdf5146 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+4:7927:x1874206984779776:12345-0@lo:104: Request processed in 71us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383172.215408:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787383172.215443:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383172.215448:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cc1bcc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+3:7927:x1874206984779904:12345-0@lo:104: 00010000:00010000:2.0:1787383172.215453:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e057 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.215477:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787383172.215481:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cc1bcc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+3:7927:x1874206984779904:12345-0@lo:104: Request processed in 34us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383172.215486:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787383172.215499:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383172.215502:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e145 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.215519:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000044a22980 already unused, calling callback (0000000045fc936d) 10000000:00010000:2.0:1787383172.215522:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e145 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.215529:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e145 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383172.215535:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e145 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383172.215541:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787383172.215562:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e145 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.215567:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383172.215581:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e145 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.215587:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 0000000044a22980/0xc40acec91532e13e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e145 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.215599:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383172.215600:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e057 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.215606:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006cba31de already unused, calling callback (0000000045fc936d) 10000000:00010000:2.0:1787383172.215607:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e057 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.215621:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e057 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383172.215626:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e057 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383172.215631:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787383172.215639:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e057 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.215644:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383172.215648:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e057 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.215653:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: 000000006cba31de/0xc40acec91532e050 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e057 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.215665:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383172.215666:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383172.215667:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383172.215672:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383172.215927:0:7927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000072866cf1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874206984779776:0@lo:104: 00000100:00100000:3.0:1787383172.215943:0:7927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d204c949 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874206984779904:0@lo:104: 00010000:00010000:3.0:1787383172.215959:0:7927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383172.216170:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d6548c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984780032:0@lo:103: 00000100:00100000:2.0:1787383172.216201:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383172.216227:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383172.216232:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d91102b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984780160:0@lo:103: 00000100:00100000:2.0:1787383172.216248:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383172.216271:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984780032 00000100:00100000:2.0:1787383172.216274:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984780032 00010000:00010000:2.0:1787383172.216289:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003fe1653a/0xc40acec91532e145 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e13e expref: 18 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383172.216400:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984780160 00000100:00100000:2.0:1787383172.216403:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984780160 00010000:00010000:2.0:1787383172.216414:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e522f6d0/0xc40acec91532e057 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e050 expref: 19 pid: 6515 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383172.216428:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787383172.216432:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a001900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+19:3649:x1874206984780032:12345-0@lo:103: 00010000:00010000:2.0:1787383172.216441:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383172.216444:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003fe1653a/0xc40acec91532e145 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e13e expref: 19 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216453:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003fe1653a/0xc40acec91532e145 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e13e expref: 19 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216464:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003fe1653a/0xc40acec91532e145 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e13e expref: 19 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216475:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383172.216497:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a001900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+18:3649:x1874206984780032:12345-0@lo:103: Request processed in 65us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383172.216502:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787383172.216513:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383172.216517:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f403d22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+17:3649:x1874206984780160:12345-0@lo:103: 00010000:00010000:2.0:1787383172.216523:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383172.216526:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e522f6d0/0xc40acec91532e057 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e050 expref: 17 pid: 6515 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216533:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e522f6d0/0xc40acec91532e057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e050 expref: 17 pid: 6515 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216546:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e522f6d0/0xc40acec91532e057 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e050 expref: 17 pid: 6515 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216555:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216561:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216571:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216577:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216583:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216589:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216594:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000069594f4c already unused, calling callback (00000000b55119d6) 00010000:00010000:2.0:1787383172.216597:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216602:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216611:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.216626:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383172.216644:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f403d22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+16:3649:x1874206984780160:12345-0@lo:103: Request processed in 127us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383172.216649:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383172.216679:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d91102b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984780160:0@lo:103: 00000100:00100000:2.0:1787383172.216749:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d6548c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984780032:0@lo:103: 00010000:00010000:3.0:1787383172.218877:0:7927:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383172.218895:0:7927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383172.219064:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000069594f4c/0xc40acec91532e1d8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383172.767186:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383173.276254:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7815884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984780288:0@lo:41: 00000100:00100000:1.0:1787383173.276325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383173.276405:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984780288 00000100:00100000:1.0:1787383173.276413:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984780288 00000100:00100000:1.0:1787383173.276452:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787383173.276460:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad3cf719 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984780288:12345-0@lo:41: 00000004:00000024:1.0:1787383173.276494:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1787383173.276542:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad3cf719 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984780288:12345-0@lo:41: Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383173.276549:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383173.277088:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7815884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984780288:0@lo:41: 00010000:00010000:3.0:1787383173.788482:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383174.812433:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383175.835434:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383176.347154:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383176.347178:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d6548c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984780416:0@lo:400: 00000100:00100000:2.0:1787383176.347262:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383176.347335:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044026eda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984780800:0@lo:400: 00000100:00100000:2.0:1787383176.347361:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383176.347382:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383176.347390:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008dbf6491 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984780928:0@lo:400: 00000100:00100000:0.0:1787383176.347393:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984780416 00000100:00100000:0.0:1787383176.347402:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984780416 00000100:00100000:2.0:1787383176.347432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383176.347451:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787383176.347461:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c01337e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:3647:x1874206984780416:12345-0@lo:400: 00000100:00100000:2.0:1787383176.347467:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eb6437f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984780544:0@lo:400: 00000100:00100000:2.0:1787383176.347515:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383176.347527:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c01337e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:3647:x1874206984780416:12345-0@lo:400: Request processed in 67us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383176.347535:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787383176.347539:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383176.347559:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d017e761 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984780672:0@lo:400: 00000100:00100000:2.0:1787383176.347584:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383176.347619:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984780928 00000100:00100000:2.0:1787383176.347631:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984780800 00000100:00100000:0.0:1787383176.347637:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984780928 00000100:00100000:2.0:1787383176.347644:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984780800 00000100:00100000:0.0:1787383176.347663:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984780672 00000100:00100000:0.0:1787383176.347667:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984780672 00000100:00100000:2.0:1787383176.347691:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984780544 00000100:00100000:0.0:1787383176.347691:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787383176.347696:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984780544 00000100:00100000:0.0:1787383176.347700:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aef33680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984780928:12345-0@lo:400: 00000100:00100000:2.0:1787383176.347719:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383176.347727:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d91102b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984780800:12345-0@lo:400: 00000100:00100000:0.0:1787383176.347744:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aef33680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984780928:12345-0@lo:400: Request processed in 45us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383176.347752:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787383176.347791:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787383176.347798:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d91102b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984780800:12345-0@lo:400: Request processed in 71us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383176.347802:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dac5660e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984780672:12345-0@lo:400: 00000100:00100000:2.0:1787383176.347812:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383176.347842:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787383176.347849:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dac5660e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984780672:12345-0@lo:400: Request processed in 51us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383176.347852:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059263747 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984780544:12345-0@lo:400: 00000100:00100000:0.0:1787383176.347861:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787383176.347888:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059263747 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984780544:12345-0@lo:400: Request processed in 39us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383176.347895:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383176.347935:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008dbf6491 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984780928:0@lo:400: 00010000:00080000:2.0:1787383176.347946:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000044026eda x1874206984780800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383176.347956:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044026eda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984780800:0@lo:400: 00000100:00100000:2.0:1787383176.347975:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d6548c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984780416:0@lo:400: 00000100:00100000:3.0:1787383176.348100:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d017e761 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984780672:0@lo:400: 00010000:00080000:3.0:1787383176.348110:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000eb6437f9 x1874206984780544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383176.348120:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eb6437f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984780544:0@lo:400: 00000100:00100000:2.0:1787383176.349621:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383176.349636:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005bb9227e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984781056:0@lo:41: 00000100:00100000:2.0:1787383176.349677:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383176.349745:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984781056 00000100:00100000:0.0:1787383176.349751:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984781056 00000100:00100000:0.0:1787383176.349818:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787383176.349826:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d6548c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984781056:12345-0@lo:41: 00000004:00000024:0.0:1787383176.349852:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787383176.349898:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d6548c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984781056:12345-0@lo:41: Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383176.349906:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787383176.349957:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005bb9227e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984781056:0@lo:41: 00010000:00010000:2.0:1787383176.859216:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383177.884734:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383178.397467:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000039c86be1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984781184:0@lo:41: 00000100:00100000:3.0:1787383178.397551:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383178.397811:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984781184 00000100:00100000:1.0:1787383178.397820:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984781184 00000100:00100000:1.0:1787383178.398141:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787383178.398150:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d204c949 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984781184:12345-0@lo:41: 00000004:00000024:1.0:1787383178.398185:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1787383178.398278:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d204c949 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984781184:12345-0@lo:41: Request processed in 129us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383178.398286:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787383178.398386:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000039c86be1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984781184:0@lo:41: 00010000:00010000:0.0:1787383178.907644:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787383179.422178:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787383179.422188:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9636183cf000 from 1 10000000:01000000:0.0:1787383179.422194:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383179.422253:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e1df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.422288:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e1df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.422301:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e1df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383179.422332:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984781312:0@lo:101: 00000100:00100000:0.0:1787383179.422436:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383179.422489:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 000000000085662e going to sleep for 11 seconds 00000100:00100000:0.0:1787383179.422515:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984781312 00000100:00100000:0.0:1787383179.422524:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984781312 00000100:00100000:0.0:1787383179.422579:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787383179.422588:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd019433 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984781312:12345-0@lo:101: 00010000:00010000:0.0:1787383179.422602:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383179.422616:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006eb2abb9/0xc40acec91532e1e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e1df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.422643:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006eb2abb9/0xc40acec91532e1e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e1df expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.422654:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006eb2abb9/0xc40acec91532e1e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e1df expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.422663:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006eb2abb9, rc 0) 00000100:00100000:0.0:1787383179.422701:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd019433 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984781312:12345-0@lo:101: Request processed in 115us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383179.422709:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787383179.422787:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984781312:0@lo:101: 00010000:00010000:0.0:1787383179.422808:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e1df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e1e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.422816:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: 00000000ae08c83f/0xc40acec91532e1df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e1e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383179.422877:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984781440:0@lo:501: 00000100:00100000:0.0:1787383179.422901:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383179.422912:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 000000000085662e going to sleep for 11 seconds 00000100:00100000:0.0:1787383179.422924:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984781440 00000100:00100000:0.0:1787383179.422927:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984781440 00000100:00100000:0.0:1787383179.422959:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787383179.422964:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdef52de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984781440:12345-0@lo:501: 00000100:00100000:0.0:1787383179.423093:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdef52de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984781440:12345-0@lo:501: Request processed in 129us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383179.423100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787383179.423124:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984781440:0@lo:501: 00000100:00100000:0.0:1787383179.423145:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984781568:0@lo:503: 00000100:00100000:0.0:1787383179.423181:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383179.423191:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set 000000000085662e going to sleep for 11 seconds 00000100:00100000:0.0:1787383179.423201:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984781568 00000100:00100000:0.0:1787383179.423204:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984781568 00000100:00100000:0.0:1787383179.423223:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787383179.423227:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6ccfdb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984781568:12345-0@lo:503: 00000100:00100000:0.0:1787383179.423304:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6ccfdb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984781568:12345-0@lo:503: Request processed in 75us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383179.423310:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787383179.423348:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984781568:0@lo:503: 00000100:00100000:0.0:1787383179.428685:0:8350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8350:1874206984781696:0@lo:502: 00000100:00100000:0.0:1787383179.428824:0:8350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383179.428869:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984781696 00000100:00100000:0.0:1787383179.428876:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984781696 00000100:00100000:0.0:1787383179.428929:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787383179.428938:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000932b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:8350:x1874206984781696:12345-0@lo:502: 00000100:00100000:0.0:1787383179.429091:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000932b56fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:8350:x1874206984781696:12345-0@lo:502: Request processed in 153us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383179.429100:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787383179.429160:0:8350:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f3a18289 going to sleep for 11 seconds 00000100:00100000:0.0:1787383179.429188:0:8350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e3c8965 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8350:1874206984781696:0@lo:502: 00000020:01000000:0.0:1787383179.429223:0:8350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383179.429234:0:8350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383179.429237:0:8350:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787383179.429245:0:8350:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9636183cf000 00000020:00000080:0.0:1787383179.429247:0:8350:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787383179.429303:0:8350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8350:1874206984781824:0@lo:502: 00000100:00100000:0.0:1787383179.429337:0:8350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383179.429361:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984781824 00000100:00100000:0.0:1787383179.429377:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984781824 00000100:00100000:0.0:1787383179.429405:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787383179.429411:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:8350:x1874206984781824:12345-0@lo:502: 00000100:00100000:0.0:1787383179.429486:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:8350:x1874206984781824:12345-0@lo:502: Request processed in 73us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383179.429493:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787383179.429529:0:8350:0:(client.c:2702:ptlrpc_set_wait()) set ffff963606513480 going to sleep for 11 seconds 00000100:00100000:0.0:1787383179.429549:0:8350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8350:1874206984781824:0@lo:502: 00000020:01000000:0.0:1787383179.429568:0:8350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383179.429573:0:8350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383179.429575:0:8350:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787383179.429578:0:8350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787383179.429653:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787383179.429672:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383179.429685:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532e1df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e1e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.429698:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532e1df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e1e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383179.429710:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787383179.429713:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9636064d1800 from 1 10000000:01000000:0.0:1787383179.429717:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383179.429746:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.429755:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.429787:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383179.429803:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984781952:0@lo:101: 00000100:00100000:0.0:1787383179.429835:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383179.429853:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963606513480 going to sleep for 11 seconds 00000100:00100000:0.0:1787383179.429868:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984781952 00000100:00100000:0.0:1787383179.429871:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984781952 00000100:00100000:0.0:1787383179.429895:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787383179.429908:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984781952:12345-0@lo:101: 00010000:00010000:0.0:1787383179.429918:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383179.429932:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c9200/0xc40acec91532e1f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e1ed expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.431600:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9200/0xc40acec91532e1f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e1ed expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.431620:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c9200/0xc40acec91532e1f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e1ed expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.431631:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9200, rc 0) 00000100:00100000:0.0:1787383179.431713:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984781952:12345-0@lo:101: Request processed in 1803us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383179.431722:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787383179.434564:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984781952:0@lo:101: 00010000:00010000:1.0:1787383179.434602:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e1f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383179.434616:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e1f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383179.434715:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984782080:0@lo:501: 00000100:00100000:1.0:1787383179.434811:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383179.434854:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6300 going to sleep for 11 seconds 00000100:00100000:1.0:1787383179.434877:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984782080 00000100:00100000:1.0:1787383179.434883:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984782080 00000100:00100000:1.0:1787383179.434958:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787383179.434969:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984782080:12345-0@lo:501: 00000100:00100000:1.0:1787383179.435133:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984782080:12345-0@lo:501: Request processed in 165us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383179.435143:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787383179.435190:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640953480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984782080:0@lo:501: 00000100:00100000:0.0:1787383179.435234:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984782208:0@lo:503: 00000100:00100000:0.0:1787383179.435284:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383179.435310:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636065130c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383179.435512:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984782208 00000100:00100000:2.0:1787383179.435518:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984782208 00000100:00100000:2.0:1787383179.435893:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787383179.435902:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984782208:12345-0@lo:503: 00000100:00100000:2.0:1787383179.436179:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984782208:12345-0@lo:503: Request processed in 276us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383179.436187:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787383179.436511:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984782208:0@lo:503: 00000100:00100000:2.0:1787383179.444740:0:8351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8351:1874206984782336:0@lo:502: 00000100:00100000:2.0:1787383179.444881:0:8351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383179.444933:0:8351:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605301d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383179.445025:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984782336 00000100:00100000:1.0:1787383179.445034:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984782336 00000100:00100000:1.0:1787383179.445092:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787383179.445102:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+18:8351:x1874206984782336:12345-0@lo:502: 00000100:00100000:1.0:1787383179.445466:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+18:8351:x1874206984782336:12345-0@lo:502: Request processed in 364us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383179.445475:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787383179.446357:0:8351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8351:1874206984782336:0@lo:502: 00000020:01000000:2.0:1787383179.446490:0:8351:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383179.446505:0:8351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383179.446508:0:8351:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787383179.446524:0:8351:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9636064d1800 00000020:00000080:2.0:1787383179.446527:0:8351:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787383179.446572:0:8351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8351:1874206984782464:0@lo:502: 00000100:00100000:2.0:1787383179.446994:0:8351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383179.447086:0:8351:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605301d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383179.447133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984782464 00000100:00100000:0.0:1787383179.447142:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984782464 00000100:00100000:0.0:1787383179.447236:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787383179.447248:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:8351:x1874206984782464:12345-0@lo:502: 00000100:00100000:0.0:1787383179.447469:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:8351:x1874206984782464:12345-0@lo:502: Request processed in 222us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383179.447478:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787383179.447561:0:8351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8351:1874206984782464:0@lo:502: 00000020:01000000:2.0:1787383179.447590:0:8351:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383179.447598:0:8351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383179.447601:0:8351:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787383179.447608:0:8351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787383179.447965:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787383179.447994:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787383179.448007:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e1f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383179.448021:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e1f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383179.937075:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787383180.740884:0:8427:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787383180.740888:0:8427:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787383180.740889:0:8427:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787383180.741048:0:8427:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff96363d95c800 00000020:01000004:1.0:1787383180.741064:0:8427:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787383180.741076:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787383180.741090:0:8427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9636313bcd40) 00000020:00000080:1.0:1787383180.741104:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787383180.783452:0:8427:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787383180.783506:0:8427:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1787383180.804500:0:8427:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787383180.804689:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787383180.804700:0:8427:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787383180.804712:0:8427:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc40acec91532e202 00000020:01000004:0.0:1787383180.804717:0:8427:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787383180.804736:0:8427:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787383180.804739:0:8427:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787383180.804745:0:8427:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787383180.804748:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787383180.804758:0:8427:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9636351b4d40) 00000020:00000080:0.0:1787383180.805224:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1787383180.807694:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787383180.807877:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787383180.807883:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787383180.812051:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787383180.812129:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787383180.813735:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787383180.813823:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787383180.826224:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383180.826421:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787383180.826435:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787383180.831745:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787383180.831759:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787383180.865522:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383180.866752:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787383180.866762:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787383180.874449:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787383180.874465:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787383180.876480:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787383180.876502:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787383180.878839:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383180.879037:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787383180.879043:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787383180.880065:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787383180.880075:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787383180.929572:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787383180.929760:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787383180.929784:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787383180.930874:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787383180.930883:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787383180.931465:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787383180.931493:0:8427:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787383180.931499:0:8427:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787383180.954235:0:8427:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787383180.954273:0:8427:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.102@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787383180.954276:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787383180.954278:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787383180.954280:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383180.954281:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383180.954282:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383180.954283:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383180.954289:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383180.954290:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787383180.954363:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787383180.954365:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383180.954367:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787383180.954371:0:8427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787383180.954373:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787383180.954375:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787383180.954376:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383180.954377:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383180.954378:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383180.954379:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383180.954380:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383180.954381:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787383180.954382:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787383180.954383:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383180.954384:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787383180.954413:0:8427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787383180.954431:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984782592:0@lo:253: 00000100:00100000:0.0:1787383180.954567:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383180.954670:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e53c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787383180.954859:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383180.955100:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984782592 00000100:00100000:1.0:1787383180.955108:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984782592 00000100:00100000:1.0:1787383180.955254:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787383180.955263:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+18:8427:x1874206984782592:12345-0@lo:253: 20000000:01000000:1.0:1787383180.955302:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787383180.955306:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787383180.955311:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787383180.955314:0:6515:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787383180.955537:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383180.955921:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787383180.955954:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787383180.955974:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787383180.955980:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787383180.955993:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787383180.956008:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787383180.956098:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787383180.956113:0:6515:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.102@tcp 20000000:01000000:1.0:1787383180.956115:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:1.0:1787383180.956258:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787383180.956265:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787383180.956305:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787383180.956313:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:1.0:1787383180.956327:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787383180.956333:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787383180.956345:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787383180.956358:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787383180.956428:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1787383180.956439:0:6515:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.102@tcp 20000000:01000000:1.0:1787383180.956440:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:1.0:1787383180.956454:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1787383180.956466:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787383180.956495:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1787383180.956501:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:1.0:1787383180.956514:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1787383180.956520:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787383180.956533:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1787383180.956548:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1787383180.957398:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1787383180.957415:0:6515:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.102@tcp 20000000:01000000:1.0:1787383180.957417:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:1.0:1787383180.957431:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1787383180.957436:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787383180.957449:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1787383180.957454:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:1.0:1787383180.957466:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1787383180.957574:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787383180.957592:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1787383180.957610:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1787383180.957622:0:6515:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787383180.957625:0:6515:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787383180.957697:0:6515:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787383180.957742:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787383180.957744:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787383180.962831:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787383180.963201:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787383180.963229:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787383180.963243:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787383180.963255:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787383180.963258:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787383180.964282:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1787383180.964339:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1787383180.964356:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787383180.964704:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1787383180.964727:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1787383180.964740:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1787383180.964752:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787383180.964755:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787383180.965242:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1787383180.965271:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1787383180.965286:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1787383180.965519:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1787383180.965542:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1787383180.965557:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1787383180.965567:0:6515:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787383180.965570:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787383180.966104:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1787383180.966211:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1787383180.966228:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787383180.966419:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787383180.966441:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787383180.966454:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:1.0:1787383180.966481:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787383180.966500:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.966520:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636421f7c00/0xc40acec91532e0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e0d5 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.966528:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636102b7600/0xc40acec91532e153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e14c expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.966534:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636102b7200/0xc40acec91532e18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e184 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.966540:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c9400/0xc40acec91532e1a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e1a0 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.966546:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c9e00/0xc40acec91532e1d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e1ca expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.966553:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.966591:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c9e00/0xc40acec91532e1d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e1ca expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.966606:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636113c9e00/0xc40acec91532e1d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e1ca expref: 18 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383180.966620:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640951f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874206984782720:0@lo:104: 00000100:00100000:1.0:1787383180.966826:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383180.967002:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c9400/0xc40acec91532e1a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e1a0 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.967011:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636113c9400/0xc40acec91532e1a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e1a0 expref: 18 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383180.967019:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640950700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874206984782848:0@lo:104: 00000100:00100000:1.0:1787383180.967042:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383180.967259:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636102b7200/0xc40acec91532e18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e184 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.967269:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636102b7200/0xc40acec91532e18b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e184 expref: 18 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383180.967278:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640953100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874206984782976:0@lo:104: 00000100:00100000:1.0:1787383180.967311:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383180.967362:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984782720 00000100:00100000:2.0:1787383180.967370:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984782720 00000100:00100000:2.0:1787383180.967406:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984782848 00000100:00100000:2.0:1787383180.967416:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984782848 00000100:00100000:2.0:1787383180.967433:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383180.967441:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640951c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+4:6515:x1874206984782720:12345-0@lo:104: 00010000:00010000:2.0:1787383180.967453:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636421f7200/0xc40acec91532e1ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e1d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.967519:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787383180.967526:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640951c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+4:6515:x1874206984782720:12345-0@lo:104: Request processed in 86us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.967533:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383180.967549:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787383180.967555:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+3:6515:x1874206984782848:12345-0@lo:104: 00010000:00010000:2.0:1787383180.967562:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532e1a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e1a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.967596:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787383180.967601:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+3:6515:x1874206984782848:12345-0@lo:104: Request processed in 46us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.967606:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1787383180.967622:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383180.967639:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636421f7200/0xc40acec91532e1ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e1d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.967646:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7200 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383180.967650:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636421f7200/0xc40acec91532e1ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e1d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.967657:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636421f7200/0xc40acec91532e1ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e1d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383180.967674:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636421f7200/0xc40acec91532e1ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e1d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383180.967679:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383180.967708:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636421f7200/0xc40acec91532e1ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e1d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.967714:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383180.967731:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636421f7200/0xc40acec91532e1ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e1d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.967738:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636421f7200/0xc40acec91532e1ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e1d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.967751:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383180.967754:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532e1a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e1a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.967760:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383180.967786:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532e1a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e1a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.967795:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532e1a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e1a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383180.967802:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532e1a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e1a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383180.967807:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383180.967827:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532e1a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e1a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.967833:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383180.967838:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532e1a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e1a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.967844:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532e1a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e1a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.967854:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383180.967856:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383180.967858:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383180.967876:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984783104:0@lo:103: 00000100:00100000:2.0:1787383180.967904:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383180.967927:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383180.967945:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984783232:0@lo:103: 00000100:00100000:2.0:1787383180.967978:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383180.968010:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984783104 00000100:00100000:2.0:1787383180.968015:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984783104 00010000:00010000:2.0:1787383180.968031:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c9e00/0xc40acec91532e1d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e1ca expref: 19 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383180.968048:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984783232 00000100:00100000:2.0:1787383180.968051:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984783232 00010000:00010000:2.0:1787383180.968061:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c9400/0xc40acec91532e1a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e1a0 expref: 20 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383180.968077:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383180.968083:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+20:3647:x1874206984783104:12345-0@lo:103: 00010000:00010000:2.0:1787383180.968100:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383180.968106:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c9e00/0xc40acec91532e1d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e1ca expref: 20 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.968117:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c9e00/0xc40acec91532e1d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e1ca expref: 20 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.968142:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383180.968168:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+20:3647:x1874206984783104:12345-0@lo:103: Request processed in 86us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.968175:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383180.968187:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787383180.968192:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+19:3647:x1874206984783232:12345-0@lo:103: 00010000:00010000:2.0:1787383180.968208:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383180.968213:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c9400/0xc40acec91532e1a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e1a0 expref: 19 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.968223:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c9400/0xc40acec91532e1a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e1a0 expref: 19 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.968233:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383180.968253:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+19:3647:x1874206984783232:12345-0@lo:103: Request processed in 61us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.968259:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787383180.968295:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984783232:0@lo:103: 00000100:00100000:2.0:1787383180.968304:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984783104:0@lo:103: 00010000:00010000:0.0:1787383180.968569:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383180.968757:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636102b7600/0xc40acec91532e153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e14c expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.968832:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636102b7600/0xc40acec91532e153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e14c expref: 18 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383180.968843:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640951180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874206984783360:0@lo:104: 00000100:00100000:1.0:1787383180.968869:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383180.968900:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636421f7c00/0xc40acec91532e0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e0d5 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.968908:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636421f7c00/0xc40acec91532e0dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e0d5 expref: 18 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383180.968926:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640950000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874206984783488:0@lo:104: 00000100:00100000:1.0:1787383180.968960:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383180.968970:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360530f000 going to sleep for 11 seconds 00010000:00010000:1.0:1787383180.968984:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9e00/0xc40acec91532e1d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e1ca expref: 18 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383180.968995:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640951f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874206984782720:0@lo:104: 00010000:00010000:1.0:1787383180.969004:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9400/0xc40acec91532e1a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e1a0 expref: 17 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383180.969012:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640950700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874206984782848:0@lo:104: 00000100:00100000:2.0:1787383180.969071:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984782976 00000100:00100000:2.0:1787383180.969076:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984782976 00000100:00100000:2.0:1787383180.969104:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984783360 00000100:00100000:2.0:1787383180.969107:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984783360 00000100:00100000:2.0:1787383180.969180:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984783488 00000100:00100000:2.0:1787383180.969185:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984783488 00000100:00100000:2.0:1787383180.969203:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787383180.969209:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640952d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+5:6515:x1874206984782976:12345-0@lo:104: 00010000:00010000:2.0:1787383180.969218:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e18b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383180.969331:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640953100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874206984782976:0@lo:104: 00010000:00010000:2.0:1787383180.969416:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787383180.969423:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640952d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+5:6515:x1874206984782976:12345-0@lo:104: Request processed in 214us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.969430:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787383180.969445:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383180.969452:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640950e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+4:6515:x1874206984783360:12345-0@lo:104: 00010000:00010000:2.0:1787383180.969460:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636421f6400/0xc40acec91532e14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e153 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383180.969598:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640951180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874206984783360:0@lo:104: 00010000:00010000:0.0:1787383180.969747:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383180.969753:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e18b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.969869:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655000 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383180.969874:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e18b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.969894:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e18b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383180.969902:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e18b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383180.969922:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787383180.969976:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e18b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.969998:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383180.970029:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e184 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e18b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.970036:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e18b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.970062:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383180.970066:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636421f6400/0xc40acec91532e14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e153 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.970098:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6400 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383180.970101:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636421f6400/0xc40acec91532e14c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e153 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.970107:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636421f6400/0xc40acec91532e14c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e153 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383180.970387:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636421f6400/0xc40acec91532e14c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e153 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383180.970410:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787383180.970450:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636421f6400/0xc40acec91532e14c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e153 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.970456:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383180.970560:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636421f6400/0xc40acec91532e14c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e153 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.970569:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636421f6400/0xc40acec91532e14c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e153 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.970582:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383180.970584:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383180.970586:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383180.970726:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984783616:0@lo:103: 00000100:00100000:3.0:1787383180.970802:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.970842:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383180.970849:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984783744:0@lo:103: 00000100:00100000:3.0:1787383180.970886:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383180.971077:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984783616 00000100:00100000:0.0:1787383180.971084:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984783616 00010000:00010000:2.0:1787383180.971193:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787383180.971203:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640950e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+4:6515:x1874206984783360:12345-0@lo:104: Request processed in 1750us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.971212:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787383180.971231:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383180.971239:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383180.971249:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+3:6515:x1874206984783488:12345-0@lo:104: 00010000:00010000:2.0:1787383180.971259:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e0d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e0dc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.971281:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636102b7200/0xc40acec91532e18b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e184 expref: 17 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.971326:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787383180.971340:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+3:6515:x1874206984783488:12345-0@lo:104: Request processed in 94us (2380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.971346:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787383180.971361:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383180.971365:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e0d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e0dc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.971373:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654600 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383180.971376:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e0d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e0dc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383180.971454:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640950000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6515:1874206984783488:0@lo:104: 00010000:00010000:2.0:1787383180.971490:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e0dc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383180.971501:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e0d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e0dc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383180.971508:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787383180.971527:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.971538:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e0d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e0dc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.971625:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787383180.971716:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984783872:0@lo:103: 00000100:00100000:3.0:1787383180.971750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383180.971820:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e0d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e0dc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.971829:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e0d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e0dc expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383180.971857:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984783744 00010000:00010000:2.0:1787383180.971859:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383180.971862:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383180.971863:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383180.971869:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984783744 00000100:00100000:2.0:1787383180.971883:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984783872 00000100:00100000:2.0:1787383180.971889:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984783872 00010000:00010000:0.0:1787383180.971889:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636102b7600/0xc40acec91532e153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e14c expref: 18 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.971908:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636421f7c00/0xc40acec91532e0dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e0d5 expref: 19 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383180.971909:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787383180.971920:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+19:3649:x1874206984783616:12345-0@lo:103: 00010000:00010000:0.0:1787383180.971944:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787383180.971948:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787383180.971952:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636102b7200/0xc40acec91532e18b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e184 expref: 19 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383180.971960:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+19:3649:x1874206984783744:12345-0@lo:103: 00010000:00010000:0.0:1787383180.971965:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636102b7200/0xc40acec91532e18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e184 expref: 19 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.971976:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383180.971984:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636102b7600/0xc40acec91532e153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e14c expref: 19 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.971985:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b7200/0xc40acec91532e18b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e184 expref: 19 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972007:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636102b7600/0xc40acec91532e153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e14c expref: 18 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383180.972170:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787383180.972182:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:0.0:1787383180.972428:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383180.972553:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b7600/0xc40acec91532e153 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e14c expref: 18 pid: 6515 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972564:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383180.972608:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+17:3649:x1874206984783744:12345-0@lo:103: Request processed in 650us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383180.972614:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+17:3649:x1874206984783616:12345-0@lo:103: Request processed in 694us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.972619:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383180.972701:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787383180.972717:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383180.972728:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+15:3647:x1874206984783872:12345-0@lo:103: 00010000:00010000:2.0:1787383180.972738:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383180.972742:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636421f7c00/0xc40acec91532e0dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e0d5 expref: 15 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972753:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636421f7c00/0xc40acec91532e0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e0d5 expref: 15 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972799:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636421f7c00/0xc40acec91532e0dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e0d5 expref: 15 pid: 6512 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972811:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972820:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972833:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972841:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972847:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972854:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972860:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383180.972864:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972872:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972894:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.972913:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383180.972941:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.972966:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.972973:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c0c00/0xc40acec91532e210 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787383180.972987:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787383180.974356:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+14:3647:x1874206984783872:12345-0@lo:103: Request processed in 1626us (2600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.974369:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787383180.974568:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984783872:0@lo:103: 00000100:00100000:0.0:1787383180.976683:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+13:8427:x1874206984782592:12345-0@lo:253: Request processed in 21414us (22108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383180.976696:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787383180.977091:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984782592:0@lo:253: 10000000:01000000:2.0:1787383180.977234:0:8427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787383180.977239:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787383180.977240:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787383180.977242:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383180.977243:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787383180.977244:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383180.977246:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383180.977247:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787383180.977248:0:8427:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787383180.977250:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383180.977251:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787383180.977283:0:8427:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96363d95c800 from lustre-OST0000 10000000:01000000:2.0:1787383180.977420:0:8427:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787383180.977423:0:8427:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787383180.977431:0:8427:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9636345a8000 local copy 10000000:01000000:2.0:1787383180.977435:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787383180.977471:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.977494:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.977520:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383180.977540:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784000:0@lo:101: 00000100:00100000:2.0:1787383180.977613:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383180.977838:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383180.977922:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984783616:0@lo:103: 00000100:00100000:3.0:1787383180.977957:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984783744:0@lo:103: 00000100:00100000:0.0:1787383180.978185:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984784000 00000100:00100000:0.0:1787383180.978193:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984784000 00000100:00100000:0.0:1787383180.978245:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787383180.978254:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+13:8427:x1874206984784000:12345-0@lo:101: 00010000:00010000:0.0:1787383180.978267:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383180.978286:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c9400/0xc40acec91532e21e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e217 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.978380:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9400/0xc40acec91532e21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e217 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.978391:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c9400/0xc40acec91532e21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e217 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.978399:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9400, rc 0) 00000100:00100000:0.0:1787383180.978437:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+14:8427:x1874206984784000:12345-0@lo:101: Request processed in 185us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383180.978444:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787383180.978605:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784000:0@lo:101: 00010000:00010000:3.0:1787383180.978619:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc40acec91532e21e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.978687:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc40acec91532e21e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383180.979067:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784128:0@lo:501: 00000100:00100000:3.0:1787383180.979101:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.979199:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383180.979247:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984784128 00000100:00100000:0.0:1787383180.979252:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984784128 00000100:00100000:0.0:1787383180.979288:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787383180.979371:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+14:8427:x1874206984784128:12345-0@lo:501: 00000100:00100000:0.0:1787383180.979443:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+14:8427:x1874206984784128:12345-0@lo:501: Request processed in 76us (342us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787383180.979450:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787383180.979609:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784128:0@lo:501: 10000000:01000000:3.0:1787383180.979622:0:8427:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787383180.979705:0:8427:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787383180.979712:0:8427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc40acec91532e21e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.979720:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc40acec91532e21e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.979727:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc40acec91532e21e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.979954:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787383180.979981:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96363d95c800 10000000:01000000:3.0:1787383180.979986:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787383180.979991:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787383180.979993:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787383180.979997:0:8427:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787383180.980011:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787383180.980032:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.980040:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.980050:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383180.980063:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784256:0@lo:101: 00000100:00100000:3.0:1787383180.980092:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383180.980191:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383180.980198:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc40acec91532e21e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.980207:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b6800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383180.980210:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc40acec91532e21e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.980218:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc40acec91532e21e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383180.980236:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc40acec91532e21e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383180.980241:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787383180.980259:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc40acec91532e21e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.980265:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383180.980284:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc40acec91532e21e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383180.980440:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984784256 00000100:00100000:2.0:1787383180.980446:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984784256 00010000:00010000:0.0:1787383180.980549:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc40acec91532e21e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383180.980563:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383180.980566:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383180.980567:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383180.980577:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383180.980588:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984784384:0@lo:103: 00000100:00100000:0.0:1787383180.980617:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383180.980715:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787383180.980723:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+14:8427:x1874206984784256:12345-0@lo:101: 00010000:00010000:2.0:1787383180.980734:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383180.980745:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b6200/0xc40acec91532e22c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e225 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.980786:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b6200/0xc40acec91532e22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e225 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.980797:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b6200/0xc40acec91532e22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e225 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383180.980806:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b6200, rc 0) 00000100:00100000:3.0:1787383180.980962:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383180.981075:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:8427:x1874206984784256:12345-0@lo:101: Request processed in 352us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.981081:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787383180.981221:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784256:0@lo:101: 00010000:00010000:3.0:1787383180.981234:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e22c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383180.981243:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e22c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383180.981440:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784512:0@lo:501: 00000100:00100000:3.0:1787383180.981468:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383180.981612:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984784384 00000100:00100000:0.0:1787383180.981617:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984784384 00000100:00100000:3.0:1787383180.981703:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383180.981957:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984784512 00000100:00100000:2.0:1787383180.981962:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984784512 00000100:00100000:2.0:1787383180.981994:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787383180.982002:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:8427:x1874206984784512:12345-0@lo:501: 00000100:00100000:2.0:1787383180.982110:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:8427:x1874206984784512:12345-0@lo:501: Request processed in 108us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.982117:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787383180.982260:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383180.982270:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+15:3647:x1874206984784384:12345-0@lo:103: 00010000:00010000:1.0:1787383180.982365:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383180.982383:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9400/0xc40acec91532e21e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e217 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383180.982396:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383180.982435:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+14:3647:x1874206984784384:12345-0@lo:103: Request processed in 167us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383180.982441:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383180.982501:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984784384:0@lo:103: 00000100:00100000:3.0:1787383180.982604:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784512:0@lo:501: 00000100:00100000:3.0:1787383180.982713:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784640:0@lo:503: 00000100:00100000:3.0:1787383180.982756:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.982888:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383180.982995:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984784640 00000100:00100000:2.0:1787383180.983006:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984784640 00000100:00100000:2.0:1787383180.983070:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787383180.983077:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+14:8427:x1874206984784640:12345-0@lo:503: 00000100:00100000:2.0:1787383180.983270:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+14:8427:x1874206984784640:12345-0@lo:503: Request processed in 193us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383180.983277:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787383180.983422:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784640:0@lo:503: 00000040:00080000:3.0:1787383180.983969:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787383180.984043:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784768:0@lo:502: 00000100:00100000:3.0:1787383180.984088:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.984130:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383180.984231:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984784768 00000100:00100000:1.0:1787383180.984237:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984784768 00000100:00100000:1.0:1787383180.984276:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787383180.984284:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+14:8427:x1874206984784768:12345-0@lo:502: 00000100:00100000:1.0:1787383180.984377:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+14:8427:x1874206984784768:12345-0@lo:502: Request processed in 93us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383180.984383:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787383180.984575:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784768:0@lo:502: 00000040:00080000:3.0:1787383180.984904:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787383180.984944:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787383180.984961:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787383180.984975:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787383180.984989:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787383180.985003:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787383180.985026:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784896:0@lo:502: 00000100:00100000:3.0:1787383180.985063:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383180.985083:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383180.985158:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984784896 00000100:00100000:1.0:1787383180.985164:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984784896 00000100:00100000:1.0:1787383180.985189:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787383180.985194:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+14:8427:x1874206984784896:12345-0@lo:502: 00000100:00100000:1.0:1787383180.985262:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+14:8427:x1874206984784896:12345-0@lo:502: Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383180.985269:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787383180.985547:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984784896:0@lo:502: 00000040:00080000:3.0:1787383180.985593:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787383180.985601:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787383180.986459:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787383180.986468:0:8451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787383180.986541:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383180.986544:0:8451:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787383180.986551:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787383180.986565:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9636313bb380) 00000020:00000080:1.0:1787383180.986593:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787383180.986600:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787383180.986759:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96363d95c800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787383180.986991:0:8451:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787383180.986998:0:8451:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc40acec91532e23a 00010000:00010000:1.0:1787383180.992759:0:8451:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1787383180.993272:0:8451:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787383180.996589:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787383180.997138:0:8451:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787383181.002313:0:8451:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787383181.002496:0:8451:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1787383181.009541:0:8451:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1787383181.012680:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787383181.012694:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383181.012701:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383181.012703:0:8451:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787383181.012707:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383181.012710:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383181.012717:0:8451:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787383181.012721:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787383181.012723:0:8451:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787383181.012756:0:8451:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383181.012760:0:8451:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383181.012761:0:8451:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787383181.012986:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787383181.013139:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787383181.013166:0:8427:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787383181.013230:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e22c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383181.013241:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e22c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383181.013249:0:8427:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96363d95c800 from 1 10000000:01000000:1.0:1787383181.013252:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787383181.013287:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383181.013294:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383181.013305:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383181.013326:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785024:0@lo:101: 00000100:00100000:1.0:1787383181.013392:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383181.013437:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360530f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787383181.013491:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984785024 00000100:00100000:0.0:1787383181.013497:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984785024 00000100:00100000:0.0:1787383181.013538:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787383181.013546:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+14:8427:x1874206984785024:12345-0@lo:101: 00010000:00010000:0.0:1787383181.013559:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383181.013571:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c9e00/0xc40acec91532e248 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e241 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383181.013592:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9e00/0xc40acec91532e248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e241 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383181.013604:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c9e00/0xc40acec91532e248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e241 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383181.013612:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9e00, rc 0) 00000100:00100000:0.0:1787383181.013690:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:8427:x1874206984785024:12345-0@lo:101: Request processed in 145us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383181.013697:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787383181.014016:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785024:0@lo:101: 00010000:00010000:1.0:1787383181.014030:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e248 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383181.014038:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e248 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383181.014122:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785152:0@lo:501: 00000100:00100000:1.0:1787383181.014148:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383181.014216:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360530f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383181.014255:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984785152 00000100:00100000:2.0:1787383181.014260:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984785152 00000100:00100000:2.0:1787383181.014322:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787383181.014331:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:8427:x1874206984785152:12345-0@lo:501: 00000100:00100000:2.0:1787383181.014435:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:8427:x1874206984785152:12345-0@lo:501: Request processed in 105us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383181.014441:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787383181.014500:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785152:0@lo:501: 00000100:00100000:1.0:1787383181.014527:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785280:0@lo:503: 00000100:00100000:1.0:1787383181.014561:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383181.014635:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360530f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787383181.014675:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984785280 00000100:00100000:0.0:1787383181.014679:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984785280 00000100:00100000:0.0:1787383181.014700:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787383181.014706:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:8427:x1874206984785280:12345-0@lo:503: 00000100:00100000:0.0:1787383181.014991:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:8427:x1874206984785280:12345-0@lo:503: Request processed in 283us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383181.015004:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787383181.015078:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785280:0@lo:503: 00000040:00080000:1.0:1787383181.015299:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787383181.015369:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785408:0@lo:502: 00000100:00100000:1.0:1787383181.015407:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383181.015439:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360530f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787383181.015487:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984785408 00000100:00100000:0.0:1787383181.015491:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984785408 00000100:00100000:0.0:1787383181.015523:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787383181.015530:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:8427:x1874206984785408:12345-0@lo:502: 00000100:00100000:0.0:1787383181.015603:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:8427:x1874206984785408:12345-0@lo:502: Request processed in 73us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383181.015609:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787383181.015685:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785408:0@lo:502: 00000040:00080000:1.0:1787383181.016128:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787383181.016155:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787383181.016176:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785536:0@lo:502: 00000100:00100000:1.0:1787383181.016216:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383181.016277:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360530f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383181.016332:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984785536 00000100:00100000:2.0:1787383181.016338:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984785536 00000100:00100000:0.0:1787383181.016974:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787383181.016984:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:8427:x1874206984785536:12345-0@lo:502: 00000100:00100000:0.0:1787383181.017090:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:8427:x1874206984785536:12345-0@lo:502: Request processed in 106us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383181.017097:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787383181.017189:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785536:0@lo:502: 00000040:00080000:3.0:1787383181.017251:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787383181.017262:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787383181.018027:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383181.018038:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383181.018040:0:8455:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787383181.018047:0:8455:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96363d95c800 00000020:00000080:3.0:1787383181.018049:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787383181.018064:0:8455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383181.018067:0:8455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383181.018068:0:8455:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787383181.018077:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787383181.018217:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787383181.018239:0:8427:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383181.018293:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e248 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383181.018305:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e248 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383181.018355:0:8427:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787383181.018359:0:8427:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96363d95c800 10000000:01000000:0.0:1787383181.018361:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96363d95c800 10000000:01000000:0.0:1787383181.018365:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383181.018370:0:8427:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96363d95c800 from 1 10000000:01000000:0.0:1787383181.018372:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787383181.018409:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383181.018417:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383181.018645:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383181.018666:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785664:0@lo:101: 00000100:00100000:0.0:1787383181.018713:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383181.018804:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620e9c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787383181.018992:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984785664 00000100:00100000:1.0:1787383181.018999:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984785664 00000100:00100000:1.0:1787383181.019031:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787383181.019039:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:8427:x1874206984785664:12345-0@lo:101: 00010000:00010000:1.0:1787383181.019050:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383181.019062:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c1200/0xc40acec91532e256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e24f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383181.019083:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c1200/0xc40acec91532e256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e24f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383181.019094:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c1200/0xc40acec91532e256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e24f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383181.019103:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1200, rc 0) 00000100:00100000:1.0:1787383181.019149:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:8427:x1874206984785664:12345-0@lo:101: Request processed in 110us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383181.019155:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787383181.019228:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785664:0@lo:101: 00010000:00010000:3.0:1787383181.019242:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e256 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.019250:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e256 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383181.019325:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785792:0@lo:501: 00000100:00100000:3.0:1787383181.019350:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383181.019376:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787383181.019387:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984785792 00000100:00100000:2.0:1787383181.019391:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984785792 00000100:00100000:2.0:1787383181.019458:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787383181.019466:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:8427:x1874206984785792:12345-0@lo:501: 00000100:00100000:2.0:1787383181.019569:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:8427:x1874206984785792:12345-0@lo:501: Request processed in 104us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383181.019576:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787383181.019633:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785792:0@lo:501: 00000100:00100000:3.0:1787383181.019662:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785920:0@lo:503: 00000100:00100000:3.0:1787383181.019697:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383181.019712:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787383181.019717:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984785920 00000100:00100000:1.0:1787383181.019722:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984785920 00000100:00100000:2.0:1787383181.019754:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787383181.019761:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:8427:x1874206984785920:12345-0@lo:503: 00000100:00100000:2.0:1787383181.020256:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:8427:x1874206984785920:12345-0@lo:503: Request processed in 495us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383181.020271:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787383181.020952:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984785920:0@lo:503: 00000040:00080000:3.0:1787383181.021175:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787383181.021230:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984786048:0@lo:502: 00000100:00100000:3.0:1787383181.021265:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383181.021297:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787383181.021303:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984786048 00000100:00100000:1.0:1787383181.021309:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984786048 00000100:00100000:1.0:1787383181.021350:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787383181.021358:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:8427:x1874206984786048:12345-0@lo:502: 00000100:00100000:1.0:1787383181.021577:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:8427:x1874206984786048:12345-0@lo:502: Request processed in 206us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383181.021584:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787383181.022143:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984786048:0@lo:502: 00000040:00080000:3.0:1787383181.022323:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787383181.022349:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787383181.022361:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787383181.022372:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787383181.022384:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787383181.022395:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787383181.022420:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787383181.023841:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787383181.023871:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787383181.023887:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787383181.023981:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787383181.024002:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787383181.024015:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787383181.024027:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787383181.024039:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787383181.024050:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787383181.024062:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787383181.024074:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787383181.024087:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787383181.024100:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787383181.024114:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787383181.024196:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787383181.024213:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787383181.024240:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787383181.024269:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787383181.024285:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787383181.024548:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787383181.024563:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1787383181.024576:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787383181.024589:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1787383181.024600:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1787383181.024615:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1787383181.024639:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1787383181.024657:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1787383181.024671:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1787383181.024697:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1787383181.024712:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1787383181.024760:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984786176:0@lo:502: 00000100:00100000:3.0:1787383181.024873:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383181.024956:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984786176 00000100:00100000:2.0:1787383181.024964:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984786176 00000100:00100000:2.0:1787383181.025015:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787383181.025024:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:8427:x1874206984786176:12345-0@lo:502: 00000100:00100000:2.0:1787383181.025140:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:8427:x1874206984786176:12345-0@lo:502: Request processed in 116us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383181.025148:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787383181.025798:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787383181.025822:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984786176:0@lo:502: 00000040:00080000:3.0:1787383181.025880:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1787383181.025889:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787383181.027646:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787383181.027662:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96363cd53380) 00000020:00000080:3.0:1787383181.028828:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787383181.029070:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96363d95c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787383181.029075:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96363d95c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787383181.029078:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96363d95c800 3 00010000:00080000:3.0:1787383181.029108:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96350233a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.102@tcp at head 00010000:00010000:3.0:1787383181.035998:0:8456:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1787383181.036107:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787383181.036151:0:8456:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787383181.036163:0:8456:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc40acec91532e264 00000100:00080000:3.0:1787383181.036172:0:8456:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787383181.036178:0:8456:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96350233a800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383181.036208:0:8456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963622eaa680 x1874206984786304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787383181.036323:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787383181.036864:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984786432:0@lo:400: 00000100:00100000:3.0:1787383181.036925:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383181.036968:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383181.036974:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984786560:0@lo:400: 00000100:00100000:3.0:1787383181.036995:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383181.037028:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984786432 00000100:00100000:3.0:1787383181.037042:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984786432 00000100:00100000:3.0:1787383181.037086:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383181.037094:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984786432:12345-0@lo:400: 00000100:00100000:1.0:1787383181.037101:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984786688:0@lo:400: 00000100:00100000:1.0:1787383181.037151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383181.037156:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984786432:12345-0@lo:400: Request processed in 59us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383181.037164:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383181.037178:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984786688 00000100:00100000:3.0:1787383181.037180:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984786688 00000100:00100000:1.0:1787383181.037184:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383181.037195:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984786816:0@lo:400: 00000100:00100000:3.0:1787383181.037199:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383181.037208:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984786688:12345-0@lo:400: 00000100:00100000:1.0:1787383181.037231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383181.037241:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984786688:12345-0@lo:400: Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383181.037248:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787383181.037271:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963640952680 x1874206984786688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383181.037277:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984786560 00000100:00100000:3.0:1787383181.037282:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984786560 00000100:00100000:1.0:1787383181.037289:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984786688:0@lo:400: 00000100:00100000:3.0:1787383181.037303:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984786816 00000100:00100000:3.0:1787383181.037307:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984786816 00000100:00100000:0.0:1787383181.037374:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984786304:0@lo:38: 00000100:00100000:0.0:1787383181.037408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383181.037495:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787383181.037503:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984786560:12345-0@lo:400: 00000100:00100000:3.0:1787383181.037617:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984786560:12345-0@lo:400: Request processed in 115us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383181.037623:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787383181.037637:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787383181.037642:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984786816:12345-0@lo:400: 00000100:00100000:3.0:1787383181.037676:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984786816:12345-0@lo:400: Request processed in 33us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383181.037681:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787383181.037703:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984786304 00000100:00100000:3.0:1787383181.037712:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984786304 00000100:00100000:3.0:1787383181.037730:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383181.037734:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1874206984786304:12345-0@lo:38: 00010000:00080000:3.0:1787383181.037751:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:3.0:1787383181.037807:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc40acec91532e26b 00000004:00100000:3.0:1787383181.037821:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787383181.037845:0:6522:0:(import.c:65:import_set_state_nolock()) ffff96350233d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383181.037878:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874206984786304:12345-0@lo:38: Request processed in 143us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383181.037885:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787383181.037916:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963622eaa680 x1874206984786304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383181.037926:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787383181.037999:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787383181.038008:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787383181.038012:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787383181.038014:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96350233a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787383181.038022:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984786304:0@lo:38: 00000100:00100000:3.0:1787383181.038053:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984786560:0@lo:400: 00010000:00080000:3.0:1787383181.038063:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963640952300 x1874206984786432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383181.038072:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984786432:0@lo:400: 00000100:00100000:0.0:1787383181.039627:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984786816:0@lo:400: 00000020:01000004:3.0:1787383181.040115:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787383181.040130:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff96363cd50000) 00000020:00000080:3.0:1787383181.040150:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1787383181.041045:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96363d95c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787383181.041051:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96363d95c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787383181.041054:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96363d95c800 3 00010000:00080000:2.0:1787383181.041097:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963502313800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1787383181.047211:0:8456:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1787383181.047379:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787383181.047426:0:8456:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787383181.047440:0:8456:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc40acec91532e279 00000100:00080000:2.0:1787383181.047450:0:8456:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383181.047456:0:8456:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff963502313800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383181.047490:0:8456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96350206aa00 x1874206984786944/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787383181.047751:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1874206984786944:0@lo:38: 00000100:00100000:3.0:1787383181.047848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383181.048236:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984786944 00000100:00100000:0.0:1787383181.048244:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984786944 00000100:00100000:0.0:1787383181.048280:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787383181.048403:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1787383181.048713:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787383181.050198:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787383181.050237:0:8427:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787383181.050263:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e256 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383181.050276:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e256 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787383181.050335:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787383181.050338:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787383181.050339:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383181.050340:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383181.050341:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383181.050343:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383181.050344:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383181.050346:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787383181.050348:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787383181.050349:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383181.050351:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787383181.050355:0:8427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787383181.050358:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787383181.050359:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787383181.050360:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383181.050362:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383181.050370:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383181.050371:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383181.050372:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383181.050373:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787383181.050374:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787383181.050375:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383181.050376:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787383181.050400:0:8427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787383181.050418:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984787072:0@lo:253: 00000100:00100000:1.0:1787383181.050478:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383181.050521:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984787072 00000100:00100000:1.0:1787383181.050521:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360530fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383181.050530:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984787072 00000100:00100000:2.0:1787383181.050618:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787383181.050630:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:8427:x1874206984787072:12345-0@lo:253: 20000000:01000000:2.0:1787383181.050657:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787383181.050977:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787383181.055494:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1874206984786944:12345-0@lo:38: 00010000:00080000:0.0:1787383181.055528:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:0.0:1787383181.055561:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc40acec91532e280 00000004:00100000:0.0:1787383181.055577:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787383181.055608:0:6522:0:(import.c:65:import_set_state_nolock()) ffff96363506e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383181.055682:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874206984786944:12345-0@lo:38: Request processed in 199us (7835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383181.055691:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787383181.055726:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96350206aa00 x1874206984786944/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383181.055738:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787383181.055746:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787383181.055752:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787383181.055757:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787383181.055760:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963502313800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787383181.055784:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1874206984786944:0@lo:38: 20000000:01000000:2.0:1787383181.056296:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787383181.056444:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787383181.057014:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787383181.057019:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787383181.057040:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.057057:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636421f6c00/0xc40acec91532e17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e176 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.057066:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636102b6400/0xc40acec91532e199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e192 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.057074:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.057115:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636102b6400/0xc40acec91532e199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e192 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.057131:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636102b6400/0xc40acec91532e199 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e192 expref: 16 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383181.057159:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984787200:0@lo:104: 00000100:00100000:2.0:1787383181.057216:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383181.057264:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636421f6c00/0xc40acec91532e17d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e176 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383181.057269:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1787383181.057274:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636421f6c00/0xc40acec91532e17d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e176 expref: 16 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383181.057284:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984787328:0@lo:104: 00000100:00100000:3.0:1787383181.057287:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984787200 00000100:00100000:3.0:1787383181.057294:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984787200 00000100:00100000:2.0:1787383181.057314:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383181.057340:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984787328 00000100:00100000:3.0:1787383181.057344:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984787328 00000100:00100000:2.0:1787383181.057346:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383181.057364:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787383181.057373:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d965c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+4:6536:x1874206984787200:12345-0@lo:104: 00010000:00010000:3.0:1787383181.057385:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963601655c00/0xc40acec91532e192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e199 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383181.057423:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:8427:x1874206984787072:12345-0@lo:253: Request processed in 6795us (6944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383181.057433:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00010000:3.0:1787383181.057442:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787383181.057453:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d965c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+4:6536:x1874206984787200:12345-0@lo:104: Request processed in 77us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383181.057453:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:8427:1874206984787072:0@lo:253: 00000100:00100000:3.0:1787383181.057465:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 10000000:01000000:1.0:1787383181.057472:0:8427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787383181.057477:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787383181.057480:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787383181.057482:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383181.057484:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383181.057486:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383181.057488:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383181.057489:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383181.057491:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787383181.057492:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787383181.057493:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383181.057494:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787383181.057512:0:8427:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787383181.057515:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787383181.057524:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+3:6536:x1874206984787328:12345-0@lo:104: 00010000:00010000:3.0:1787383181.057532:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636102b6c00/0xc40acec91532e176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e17d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.057558:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787383181.057563:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+3:6536:x1874206984787328:12345-0@lo:104: Request processed in 41us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383181.057567:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1787383181.057580:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383181.057585:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963601655c00/0xc40acec91532e192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e199 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.057597:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655c00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383181.057601:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963601655c00/0xc40acec91532e192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e199 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.057609:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601655c00/0xc40acec91532e192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e199 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383181.057616:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601655c00/0xc40acec91532e192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e199 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383181.057622:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787383181.057652:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963601655c00/0xc40acec91532e192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e199 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.057658:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383181.057672:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963601655c00/0xc40acec91532e192 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e199 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.057679:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601655c00/0xc40acec91532e192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e199 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.057691:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383181.057694:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b6c00/0xc40acec91532e176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e17d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.057700:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b6c00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383181.057703:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b6c00/0xc40acec91532e176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e17d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.057717:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b6c00/0xc40acec91532e176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e17d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383181.057727:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b6c00/0xc40acec91532e176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e17d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383181.057732:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787383181.057752:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636102b6c00/0xc40acec91532e176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e17d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.057758:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383181.057763:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b6c00/0xc40acec91532e176 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e17d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.057786:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b6c00/0xc40acec91532e176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e17d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.057797:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383181.057799:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383181.057800:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383181.057805:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383181.057814:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984787456:0@lo:103: 00000100:00100000:3.0:1787383181.057839:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383181.057858:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383181.057863:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984787584:0@lo:103: 00000100:00100000:3.0:1787383181.057877:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383181.057900:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984787456 00000100:00100000:3.0:1787383181.057903:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984787456 00010000:00010000:3.0:1787383181.057916:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636102b6400/0xc40acec91532e199 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e192 expref: 16 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383181.057956:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984787584 00000100:00100000:3.0:1787383181.057959:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984787584 00010000:00010000:3.0:1787383181.057972:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636421f6c00/0xc40acec91532e17d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e176 expref: 17 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383181.057979:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383181.057990:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+17:3649:x1874206984787456:12345-0@lo:103: 00010000:00010000:2.0:1787383181.058000:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383181.058007:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636102b6400/0xc40acec91532e199 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e192 expref: 17 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.058020:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636102b6400/0xc40acec91532e199 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e192 expref: 17 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.058035:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383181.058075:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+17:3649:x1874206984787456:12345-0@lo:103: Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383181.058121:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984787456:0@lo:103: 00000100:00100000:2.0:1787383181.059097:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383181.059135:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383181.059143:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+16:3649:x1874206984787584:12345-0@lo:103: 00010000:00010000:2.0:1787383181.059155:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383181.059162:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636421f6c00/0xc40acec91532e17d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e176 expref: 16 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.059176:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636421f6c00/0xc40acec91532e17d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e176 expref: 16 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.059197:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.059207:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787383181.059222:0:8450:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008434574s 00010000:00010000:2.0:1787383181.059227:0:8450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.059235:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.059242:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.059249:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.059256:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7600 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383181.059260:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.059278:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.059289:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383181.059299:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383181.059345:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+16:3649:x1874206984787584:12345-0@lo:103: Request processed in 203us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383181.059352:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1787383181.059481:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b6400/0xc40acec91532e199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e192 expref: 15 pid: 6515 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383181.059493:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984787200:0@lo:104: 00010000:00010000:3.0:1787383181.059703:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636421f6c00/0xc40acec91532e17d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e176 expref: 14 pid: 6514 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383181.059714:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984787328:0@lo:104: 00010000:00010000:3.0:1787383181.059737:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.059746:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.059753:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383181.059760:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b7600/0xc40acec91532e287 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383181.060035:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984787584:0@lo:103: 00080000:10000000:1.0:1787383181.067532:0:8427:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787383181.067702:0:8427:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787383181.070476:0:8427:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787383181.070655:0:8427:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787383181.071009:0:8427:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787383181.071238:0:8427:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1787383181.072441:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787383181.083462:0:8427:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787383181.083471:0:8427:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787383181.083520:0:8427:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787383181.083559:0:8427:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787383181.083579:0:8427:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787383181.083599:0:8427:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787383181.084424:0:8427:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787383181.084624:0:8427:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1787383181.468788:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984787712:0@lo:41: 00000100:00100000:3.0:1787383181.468865:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383181.469008:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984787712 00000100:00100000:1.0:1787383181.469017:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984787712 00000100:00100000:1.0:1787383181.469068:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787383181.469078:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984787712:12345-0@lo:41: 00000004:00000024:1.0:1787383181.469111:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787383181.469156:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984787712:12345-0@lo:41: Request processed in 80us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383181.469164:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787383181.469554:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984787712:0@lo:41: 00000020:00000004:0.0:1787383181.932880:0:8512:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383181.933127:0:8512:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787383181.979743:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383183.004147:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383183.514930:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984787840:0@lo:41: 00000100:00100000:0.0:1787383183.514998:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383183.515273:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984787840 00000100:00100000:2.0:1787383183.515281:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984787840 00000100:00100000:2.0:1787383183.515332:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787383183.515555:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984787840:12345-0@lo:41: 00000004:00000024:2.0:1787383183.515589:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1787383183.518287:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984787840:12345-0@lo:41: Request processed in 2727us (3280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383183.518301:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787383183.518907:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984787840:0@lo:41: 00010000:00010000:1.0:1787383184.027018:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383185.053658:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383186.076111:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984788096:0@lo:400: 00000100:00100000:1.0:1787383186.076211:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383186.076278:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984788608:0@lo:400: 00000100:00100000:1.0:1787383186.076305:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383186.076335:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787383186.076342:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984787968:0@lo:400: 00000100:00100000:1.0:1787383186.076376:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383186.076399:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984788480:0@lo:400: 00000100:00100000:1.0:1787383186.076426:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383186.076456:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984788224:0@lo:400: 00000100:00100000:1.0:1787383186.076482:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383186.076497:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984788736:0@lo:400: 00000100:00100000:1.0:1787383186.076540:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383186.076559:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383186.076564:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984788352:0@lo:400: 00000100:00100000:1.0:1787383186.076603:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383186.076824:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984788480 00000100:00100000:2.0:1787383186.076834:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984788480 00000100:00100000:2.0:1787383186.076882:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984788224 00000100:00100000:2.0:1787383186.076886:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984788224 00000100:00100000:2.0:1787383186.076918:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787383186.076928:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984788480:12345-0@lo:400: 00010000:00010000:3.0:1787383186.079020:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383186.083647:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984788480:12345-0@lo:400: Request processed in 6693us (7193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383186.083689:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787383186.083752:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787383186.083784:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984788224:12345-0@lo:400: 00000100:00100000:2.0:1787383186.083891:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984788224:12345-0@lo:400: Request processed in 130us (7408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383186.083908:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787383186.083967:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984788224:0@lo:400: 00000100:00100000:2.0:1787383186.085355:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984787968 00000100:00100000:2.0:1787383186.085379:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984787968 00000100:00100000:2.0:1787383186.085460:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787383186.085469:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+14:3650:x1874206984787968:12345-0@lo:400: 00000100:00100000:2.0:1787383186.085555:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+14:3650:x1874206984787968:12345-0@lo:400: Request processed in 88us (9178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383186.085562:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787383186.085603:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984788096 00000100:00100000:2.0:1787383186.085607:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984788096 00000100:00100000:2.0:1787383186.085629:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984788608 00000100:00100000:2.0:1787383186.085632:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984788608 00000100:00100000:2.0:1787383186.085667:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984788736 00000100:00100000:2.0:1787383186.085671:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984788736 00000100:00100000:2.0:1787383186.085686:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984788352 00000100:00100000:2.0:1787383186.085688:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984788352 00000100:00100000:2.0:1787383186.085701:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383186.085706:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984788096:12345-0@lo:400: 00000100:00100000:2.0:1787383186.085744:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984788096:12345-0@lo:400: Request processed in 37us (9534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383186.085749:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383186.085804:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383186.085810:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984788608:12345-0@lo:400: 00000100:00100000:2.0:1787383186.085842:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984788608:12345-0@lo:400: Request processed in 32us (9535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383186.085847:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383186.085858:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383186.085864:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984788736:12345-0@lo:400: 00000100:00100000:2.0:1787383186.085909:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984788736:12345-0@lo:400: Request processed in 33us (9357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383186.085915:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383186.085927:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383186.085932:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984788352:12345-0@lo:400: 00000100:00100000:2.0:1787383186.085961:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984788352:12345-0@lo:400: Request processed in 29us (9358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383186.085966:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787383186.086017:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963640953b80 x1874206984788352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383186.086035:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984788352:0@lo:400: 00010000:00080000:2.0:1787383186.086049:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963640952d80 x1874206984788736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383186.086057:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984788736:0@lo:400: 00000100:00080000:1.0:1787383186.097372:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383186.097387:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383186.097471:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984787968:0@lo:400: 00000100:00100000:1.0:1787383186.097496:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984788480:0@lo:400: 00010000:00080000:1.0:1787383186.097517:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963640951f80 x1874206984788096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383186.097529:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984788096:0@lo:400: 00010000:00080000:1.0:1787383186.097543:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963640952a00 x1874206984788608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383186.097551:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984788608:0@lo:400: 00000100:00100000:2.0:1787383186.590974:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984788864:0@lo:41: 00000100:00100000:2.0:1787383186.591081:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383186.591220:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984788864 00000100:00100000:2.0:1787383186.591229:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984788864 00000100:00100000:2.0:1787383186.591300:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787383186.591311:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984788864:12345-0@lo:41: 00000004:00000024:2.0:1787383186.591358:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787383186.591410:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984788864:12345-0@lo:41: Request processed in 100us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383186.591418:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787383186.591483:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984788864:0@lo:41: 00000001:02000400:1.0:1787383186.878341:0:8802:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787383187.100573:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787383187.634343:0:8854:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787383187.634591:0:8854:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787383188.123025:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383188.635326:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383188.635353:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984788992:0@lo:41: 00000100:00100000:1.0:1787383188.635420:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383188.635681:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984788992 00000100:00100000:3.0:1787383188.635689:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984788992 00000100:00100000:3.0:1787383188.635752:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383188.635762:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984788992:12345-0@lo:41: 00000004:00000024:3.0:1787383188.635815:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1787383188.635859:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984788992:12345-0@lo:41: Request processed in 98us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383188.635866:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787383188.636021:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984788992:0@lo:41: 00010000:00010000:0.0:1787383189.146974:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787383189.147135:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787383189.147139:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9636183cf000 from 30 10000000:01000000:2.0:1787383189.147145:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787383189.147199:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383189.147211:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383189.147222:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383189.147260:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984789120:0@lo:101: 00000100:00100000:2.0:1787383189.147345:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383189.147563:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397540 going to sleep for 11 seconds 00000100:00100000:0.0:1787383189.151101:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984789120 00000100:00100000:0.0:1787383189.151115:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984789120 00000100:00100000:0.0:1787383189.151503:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787383189.151526:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+14:6517:x1874206984789120:12345-0@lo:101: 00010000:00010000:0.0:1787383189.151545:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383189.151565:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c9a00/0xc40acec91532e295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e28e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383189.151595:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9a00/0xc40acec91532e295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e28e expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383189.151607:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c9a00/0xc40acec91532e295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e28e expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383189.151616:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9a00, rc 0) 00000100:00100000:0.0:1787383189.151706:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984789120:12345-0@lo:101: Request processed in 183us (4361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383189.151713:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787383189.151805:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984789120:0@lo:101: 00010000:00010000:3.0:1787383189.151822:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.151832:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383189.151918:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984789248:0@lo:501: 00000100:00100000:3.0:1787383189.151952:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.153010:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a0e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383189.153064:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984789248 00000100:00100000:2.0:1787383189.153072:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984789248 00000100:00100000:0.0:1787383189.153140:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787383189.153150:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984789248:12345-0@lo:501: 00000100:00100000:0.0:1787383189.153294:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984789248:12345-0@lo:501: Request processed in 146us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383189.153317:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787383189.153390:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984789248:0@lo:501: 00000100:00100000:3.0:1787383189.153425:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984789376:0@lo:503: 00000100:00100000:3.0:1787383189.153476:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.154081:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a0e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383189.154215:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984789376 00000100:00100000:1.0:1787383189.154222:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984789376 00000100:00100000:1.0:1787383189.154253:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787383189.154261:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984789376:12345-0@lo:503: 00000100:00100000:1.0:1787383189.154374:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984789376:12345-0@lo:503: Request processed in 113us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.154381:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787383189.154472:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984789376:0@lo:503: 00000100:00100000:3.0:1787383189.154960:0:8906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8906:1874206984789504:0@lo:502: 00000100:00100000:3.0:1787383189.154996:0:8906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.155027:0:8906:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a0ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383189.157821:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984789504 00000100:00100000:1.0:1787383189.157835:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984789504 00000100:00100000:1.0:1787383189.157899:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787383189.157909:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96361a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:8906:x1874206984789504:12345-0@lo:502: 00000100:00100000:1.0:1787383189.158118:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96361a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:8906:x1874206984789504:12345-0@lo:502: Request processed in 211us (3121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.158127:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787383189.159589:0:8906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8906:1874206984789504:0@lo:502: 00000100:00100000:3.0:1787383189.159673:0:8906:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8906:1874206984789632:0@lo:502: 00000100:00100000:3.0:1787383189.159954:0:8906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.159984:0:8906:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a0ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383189.160136:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984789632 00000100:00100000:1.0:1787383189.160142:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984789632 00000100:00100000:1.0:1787383189.160181:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787383189.160190:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:8906:x1874206984789632:12345-0@lo:502: 00000100:00100000:1.0:1787383189.160307:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:8906:x1874206984789632:12345-0@lo:502: Request processed in 117us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.160315:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787383189.160553:0:8906:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8906:1874206984789632:0@lo:502: 00000040:00080000:3.0:1787383189.160870:0:8906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787383189.161044:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787383189.161064:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787383189.161075:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.161087:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383189.161096:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787383189.161098:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9636183cf000 from 5 10000000:01000000:1.0:1787383189.161100:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787383189.161140:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.161148:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.161156:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383189.161172:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984789760:0@lo:101: 00000100:00100000:1.0:1787383189.161210:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.161244:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610ee8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383189.161294:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984789760 00000100:00100000:3.0:1787383189.161299:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984789760 00000100:00100000:3.0:1787383189.161325:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787383189.161332:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984789760:12345-0@lo:101: 00010000:00010000:3.0:1787383189.161342:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383189.161354:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963601654e00/0xc40acec91532e2a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e29c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.161376:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963601654e00/0xc40acec91532e2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e29c expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.161385:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963601654e00/0xc40acec91532e2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e29c expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.161394:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601654e00, rc 0) 00000100:00100000:3.0:1787383189.161470:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984789760:12345-0@lo:101: Request processed in 139us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.161476:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787383189.162000:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984789760:0@lo:101: 00010000:00010000:1.0:1787383189.162015:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.162023:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383189.162072:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984789888:0@lo:256: 00000100:00100000:1.0:1787383189.162106:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.162161:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610ee8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383189.162196:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984789888 00000100:00100000:3.0:1787383189.162200:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984789888 00000100:00100000:3.0:1787383189.162263:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787383189.162270:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984789888:12345-0@lo:256: 20000000:01000000:3.0:1787383189.162282:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787383189.162299:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787383189.162302:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787383189.162385:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984789888:12345-0@lo:256: Request processed in 115us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.162392:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787383189.162450:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984789888:0@lo:256: 10000000:01000000:1.0:1787383189.162490:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787383189.162497:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.162505:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383189.162529:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787383189.162530:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1787383189.162532:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787383189.162551:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.162558:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.162565:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383189.162577:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984790016:0@lo:101: 00000100:00100000:1.0:1787383189.162603:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.162944:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610ee8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383189.162996:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984790016 00000100:00100000:2.0:1787383189.163001:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984790016 00000100:00100000:3.0:1787383189.163046:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787383189.163053:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984790016:12345-0@lo:101: 00010000:00010000:3.0:1787383189.163063:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383189.163073:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963601655c00/0xc40acec91532e2b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e2aa expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.163092:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963601655c00/0xc40acec91532e2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e2aa expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.163100:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963601655c00/0xc40acec91532e2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e2aa expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.163107:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655c00, rc 0) 00000100:00100000:3.0:1787383189.163145:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984790016:12345-0@lo:101: Request processed in 92us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.163151:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787383189.163256:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984790016:0@lo:101: 00010000:00010000:1.0:1787383189.163268:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.163276:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383189.163330:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984790144:0@lo:501: 00000100:00100000:1.0:1787383189.163354:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.163501:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610ee8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383189.163759:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984790144 00000100:00100000:0.0:1787383189.163783:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984790144 00000100:00100000:0.0:1787383189.163807:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787383189.163814:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984790144:12345-0@lo:501: 00000100:00100000:0.0:1787383189.163943:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984790144:12345-0@lo:501: Request processed in 129us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383189.163950:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787383189.164043:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984790144:0@lo:501: 00000100:00100000:1.0:1787383189.164071:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984790272:0@lo:503: 00000100:00100000:1.0:1787383189.164129:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.164146:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610ee8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383189.164234:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984790272 00000100:00100000:0.0:1787383189.164238:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984790272 00000100:00100000:0.0:1787383189.164254:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787383189.164258:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984790272:12345-0@lo:503: 00000100:00100000:0.0:1787383189.164337:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984790272:12345-0@lo:503: Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383189.164344:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787383189.164451:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984790272:0@lo:503: 00000100:00100000:1.0:1787383189.165209:0:8907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8907:1874206984790400:0@lo:502: 00000100:00100000:1.0:1787383189.165253:0:8907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.165319:0:8907:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610ee8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383189.165354:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984790400 00000100:00100000:0.0:1787383189.165358:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984790400 00000100:00100000:0.0:1787383189.165427:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787383189.165435:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:8907:x1874206984790400:12345-0@lo:502: 00000100:00100000:0.0:1787383189.165599:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:8907:x1874206984790400:12345-0@lo:502: Request processed in 165us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383189.165607:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787383189.165678:0:8907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8907:1874206984790400:0@lo:502: 00000020:01000000:1.0:1787383189.165714:0:8907:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787383189.165722:0:8907:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787383189.165728:0:8907:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383189.165731:0:8907:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787383189.165736:0:8907:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787383189.165739:0:8907:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:1.0:1787383189.165759:0:8907:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787383189.165763:0:8907:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787383189.165817:0:8907:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9636352c99c0) 00000020:00000080:1.0:1787383189.165838:0:8907:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1787383189.165845:0:8907:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787383189.165954:0:8907:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787383189.165960:0:8907:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787383189.165967:0:8907:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532e2bf 00010000:00080000:1.0:1787383189.165995:0:8907:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96363db9d000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1787383189.166355:0:8907:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787383189.181279:0:8907:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787383189.181307:0:8907:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787383189.181526:0:8907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383189.182014:0:8907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383189.182104:0:8907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787383189.182203:0:8907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787383189.182614:0:8908:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383189.182619:0:8908:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787383189.183423:0:8907:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787383189.183435:0:8907:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787383189.183472:0:8907:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787383189.183496:0:8907:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532e2c6 00000100:00080000:1.0:1787383189.183516:0:8907:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787383189.183523:0:8907:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96363db9d000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383189.183557:0:8907:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963502015880 x1874206984790528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383189.183623:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984790528:0@lo:8: 00000100:00100000:2.0:1787383189.183703:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383189.184167:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984790528 00000100:00100000:0.0:1787383189.184175:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984790528 00000100:00100000:0.0:1787383189.184216:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383189.184224:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1874206984790528:12345-0@lo:8: 00010000:00080000:0.0:1787383189.184247:0:8434:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:0.0:1787383189.184280:0:8434:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532e2cd 00002000:00100000:0.0:1787383189.184313:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff96363d9ca800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787383189.184317:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1787383189.184321:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787383189.184379:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787383189.184590:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787383189.184612:0:8434:0:(import.c:65:import_set_state_nolock()) ffff96363d9cd000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787383189.184702:0:8907:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787383189.185063:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984790656:0@lo:400: 00000100:00100000:1.0:1787383189.185096:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.185127:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984791168:0@lo:400: 00000100:00100000:1.0:1787383189.185147:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.185166:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383189.185172:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984791040:0@lo:400: 00000100:00100000:1.0:1787383189.185196:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.185222:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984790656 00000100:00100000:1.0:1787383189.185226:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984790656 00000100:00100000:1.0:1787383189.185255:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984791168 00000100:00100000:1.0:1787383189.185258:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984791168 00000100:00100000:1.0:1787383189.185280:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787383189.185287:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984790656:12345-0@lo:400: 00000100:00100000:1.0:1787383189.185324:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984790656:12345-0@lo:400: Request processed in 37us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.185331:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787383189.185344:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787383189.185350:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984791168:12345-0@lo:400: 00000100:00100000:1.0:1787383189.185385:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984791168:12345-0@lo:400: Request processed in 36us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.185391:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787383189.185501:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984791040 00000100:00100000:1.0:1787383189.185505:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984791040 00000100:00100000:1.0:1787383189.185538:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383189.185545:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984791040:12345-0@lo:400: 00000100:00100000:1.0:1787383189.185576:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984791040:12345-0@lo:400: Request processed in 32us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.185582:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787383189.185602:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383189.185626:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984791040:0@lo:400: 00010000:00080000:1.0:1787383189.185638:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963502016a00 x1874206984790656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383189.185647:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984790656:0@lo:400: 00010000:00080000:1.0:1787383189.185655:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963502014a80 x1874206984791168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383189.185663:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984791168:0@lo:400: 00000100:00100000:3.0:1787383189.185810:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984790784:0@lo:400: 00000100:00100000:3.0:1787383189.185856:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.185886:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984791296:0@lo:400: 00000100:00100000:3.0:1787383189.185923:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.185941:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383189.185947:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984790912:0@lo:400: 00000100:00100000:3.0:1787383189.185966:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.185989:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984791296 00000100:00100000:3.0:1787383189.185993:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984791296 00000100:00100000:3.0:1787383189.186017:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984790912 00000100:00100000:3.0:1787383189.186020:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984790912 00000100:00100000:3.0:1787383189.186033:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787383189.186038:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984791296:12345-0@lo:400: 00000100:00100000:3.0:1787383189.186074:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984791296:12345-0@lo:400: Request processed in 35us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.186080:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787383189.186092:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787383189.186097:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984790912:12345-0@lo:400: 00000100:00100000:3.0:1787383189.186122:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984790912:12345-0@lo:400: Request processed in 26us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.186128:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787383189.186154:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963502017100 x1874206984790912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383189.186163:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984790912:0@lo:400: 00010000:00080000:3.0:1787383189.186172:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963502014380 x1874206984791296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383189.186179:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984791296:0@lo:400: 00000100:00100000:1.0:1787383189.186316:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984790784 00000100:00100000:1.0:1787383189.186319:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984790784 00000100:00100000:1.0:1787383189.186354:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787383189.186360:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984790784:12345-0@lo:400: 00000100:00100000:1.0:1787383189.186390:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984790784:12345-0@lo:400: Request processed in 31us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.186457:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787383189.186481:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383189.186500:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984790784:0@lo:400: 00000020:01000000:1.0:1787383189.186583:0:8907:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383189.186590:0:8907:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383189.186591:0:8907:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787383189.186594:0:8907:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383189.186598:0:8907:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383189.186599:0:8907:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787383189.186602:0:8907:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787383189.186604:0:8907:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787383189.186631:0:8907:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502016300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8907:1874206984791424:0@lo:502: 00000100:00100000:1.0:1787383189.186670:0:8907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.187165:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984791424 00000100:00100000:1.0:1787383189.187170:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984791424 00000100:00100000:1.0:1787383189.187205:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787383189.187212:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:8907:x1874206984791424:12345-0@lo:502: 00000100:00100000:1.0:1787383189.187319:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:8907:x1874206984791424:12345-0@lo:502: Request processed in 106us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.187325:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787383189.187366:0:8907:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636050c30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383189.187379:0:8907:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502016300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8907:1874206984791424:0@lo:502: 00000020:01000000:1.0:1787383189.187529:0:8907:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383189.187535:0:8907:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383189.187537:0:8907:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787383189.187541:0:8907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1787383189.188253:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1787383189.188276:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787383189.188287:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.188297:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383189.188307:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787383189.188310:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9636064d1800 from 30 10000000:01000000:3.0:1787383189.188313:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787383189.188340:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.188349:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.188358:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383189.188377:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984791552:0@lo:101: 00000100:00100000:0.0:1787383189.188495:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874206984790528:12345-0@lo:8: Request processed in 4268us (4789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383189.188504:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383189.193070:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.193171:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963602ae9000 going to sleep for 11 seconds 00010000:00080000:2.0:1787383189.195599:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963502015880 x1874206984790528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383189.195632:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787383189.195642:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787383189.195651:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787383189.195658:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787383189.195661:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363db9d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787383189.195688:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787383189.195695:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502015880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984790528:0@lo:8: 00000004:00080000:3.0:1787383189.195996:0:8908:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787383189.196078:0:8908:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 222224311371ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787383189.196085:0:8908:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787383189.196148:0:8909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1874206984791680:0@lo:700: 00000100:00100000:3.0:1787383189.196214:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.196249:0:8909:0:(client.c:2702:ptlrpc_set_wait()) set ffff963602ae9600 going to sleep for 11 seconds 00000004:00080000:0.0:1787383189.197866:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787383189.198240:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984791680 00000100:00100000:2.0:1787383189.198249:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984791680 00000100:00080000:0.0:1787383189.198351:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383189.198401:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383189.198412:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8909:x1874206984791680:12345-0@lo:700: 00000100:00100000:2.0:1787383189.198466:0:8442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8442:1874206984791808:0@lo:700: 00000100:00100000:2.0:1787383189.198524:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383189.198562:0:8442:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397300 going to sleep for 11 seconds 00000100:00100000:0.0:1787383189.198690:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984791808 00000100:00100000:0.0:1787383189.198694:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984791808 00000100:00100000:0.0:1787383189.198729:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383189.198736:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8442:x1874206984791808:12345-0@lo:700: 00000100:00100000:1.0:1787383189.200595:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984791552 00000100:00100000:1.0:1787383189.200609:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984791552 00000100:00100000:1.0:1787383189.200668:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787383189.200679:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984791552:12345-0@lo:101: 00010000:00010000:1.0:1787383189.200721:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383189.200739:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c0000/0xc40acec91532e2db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e2d4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.200783:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0000/0xc40acec91532e2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e2d4 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.200795:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c0000/0xc40acec91532e2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e2d4 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.200804:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0000, rc 0) 00000100:00100000:1.0:1787383189.201066:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984791552:12345-0@lo:101: Request processed in 388us (8002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.201074:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787383189.201167:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984791552:0@lo:101: 00010000:00010000:2.0:1787383189.201187:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2db expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383189.201196:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e2db expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383189.201270:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984791936:0@lo:501: 00000100:00100000:2.0:1787383189.201303:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383189.201342:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397780 going to sleep for 11 seconds 00000100:00100000:1.0:1787383189.202309:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984791936 00000100:00100000:1.0:1787383189.202318:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984791936 00000100:00100000:1.0:1787383189.202357:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787383189.202365:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984791936:12345-0@lo:501: 00000100:00100000:1.0:1787383189.202514:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984791936:12345-0@lo:501: Request processed in 149us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.202522:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787383189.202673:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984791936:0@lo:501: 00000100:00100000:0.0:1787383189.202726:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984792064:0@lo:503: 00000100:00100000:0.0:1787383189.202805:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383189.202845:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91480 going to sleep for 11 seconds 00000100:00100000:1.0:1787383189.203053:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984792064 00000100:00100000:1.0:1787383189.203058:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984792064 00000100:00100000:1.0:1787383189.203082:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787383189.203090:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984792064:12345-0@lo:503: 00000100:00100000:1.0:1787383189.203187:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984792064:12345-0@lo:503: Request processed in 98us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.203194:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787383189.203241:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984792064:0@lo:503: 00000100:00100000:1.0:1787383189.204537:0:8910:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502016300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8910:1874206984792192:0@lo:502: 00000100:00100000:1.0:1787383189.204604:0:8910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.204634:0:8910:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636064c6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383189.204731:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984792192 00000100:00100000:2.0:1787383189.204738:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984792192 00000100:00100000:2.0:1787383189.204951:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787383189.204962:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:8910:x1874206984792192:12345-0@lo:502: 00000100:00100000:2.0:1787383189.205071:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:8910:x1874206984792192:12345-0@lo:502: Request processed in 111us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383189.205078:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 40000000:02000000:2.0:1787383189.205627:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1787383189.206952:0:8910:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502016300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8910:1874206984792192:0@lo:502: 00000100:00100000:1.0:1787383189.207035:0:8910:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502016300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8910:1874206984792320:0@lo:502: 00000100:00100000:1.0:1787383189.207094:0:8910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.207130:0:8910:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636064c6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383189.207515:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984792320 00000100:00100000:0.0:1787383189.207523:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984792320 00000100:00100000:0.0:1787383189.207566:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787383189.207574:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+18:8910:x1874206984792320:12345-0@lo:502: 00000100:00100000:0.0:1787383189.207706:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+18:8910:x1874206984792320:12345-0@lo:502: Request processed in 132us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383189.207723:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787383189.208553:0:8910:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502016300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8910:1874206984792320:0@lo:502: 00000040:00080000:1.0:1787383189.208586:0:8910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787383189.209575:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787383189.209608:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787383189.209620:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2db expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383189.209632:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2db expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383189.209643:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787383189.209646:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9636064d1800 from 5 10000000:01000000:0.0:1787383189.209648:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787383189.209697:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383189.209705:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383189.209714:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383189.209735:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984792448:0@lo:101: 00000100:00100000:0.0:1787383189.209813:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383189.210058:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383189.210104:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984792448 00000100:00100000:1.0:1787383189.210111:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984792448 00000100:00100000:1.0:1787383189.210158:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787383189.210184:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984792448:12345-0@lo:101: 00010000:00010000:1.0:1787383189.210196:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383189.210208:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c0400/0xc40acec91532e2e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e2e2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.210231:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0400/0xc40acec91532e2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e2e2 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.210239:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c0400/0xc40acec91532e2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e2e2 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.210248:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0400, rc 0) 00000100:00100000:1.0:1787383189.210287:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984792448:12345-0@lo:101: Request processed in 104us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.210307:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787383189.211971:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984792448:0@lo:101: 00010000:00010000:1.0:1787383189.211996:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.212006:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e2e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383189.212082:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984792576:0@lo:256: 00000100:00100000:1.0:1787383189.212139:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.212170:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636064c6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383189.212534:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984792576 00000100:00100000:3.0:1787383189.212540:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984792576 00000100:00100000:3.0:1787383189.212586:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787383189.212594:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984792576:12345-0@lo:256: 20000000:01000000:3.0:1787383189.212615:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787383189.212633:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787383189.212637:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787383189.212737:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984792576:12345-0@lo:256: Request processed in 143us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.212744:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787383189.213653:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984792576:0@lo:256: 10000000:01000000:1.0:1787383189.213997:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787383189.214008:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.214019:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383189.214028:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787383189.214031:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787383189.214033:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787383189.214061:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.214068:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.214089:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383189.214106:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984792704:0@lo:101: 00000100:00100000:1.0:1787383189.214146:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.214218:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636064c6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383189.221495:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8442:x1874206984791808:12345-0@lo:700: Request processed in 22752us (22963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383189.221515:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787383189.221612:0:8442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963502069c00 x1874206984791808/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787383205 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383189.221628:0:8442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8442:1874206984791808:0@lo:700: 40000000:02000000:1.0:1787383189.221640:0:8442:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1787383189.224077:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984792704 00000100:00100000:3.0:1787383189.224091:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984792704 00000100:00100000:3.0:1787383189.224170:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787383189.224181:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984792704:12345-0@lo:101: 00010000:00010000:3.0:1787383189.224198:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383189.224218:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963601655600/0xc40acec91532e2f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e2f0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.224245:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963601655600/0xc40acec91532e2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e2f0 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.224257:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963601655600/0xc40acec91532e2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e2f0 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.224266:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655600, rc 0) 00000100:00100000:3.0:1787383189.224337:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984792704:12345-0@lo:101: Request processed in 159us (10190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.224343:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787383189.229702:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984792704:0@lo:101: 00010000:00010000:2.0:1787383189.229727:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383189.229739:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e2f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383189.229833:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984792832:0@lo:501: 00000100:00100000:2.0:1787383189.229900:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383189.229943:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383189.231014:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984792832 00000100:00100000:1.0:1787383189.231023:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984792832 00000100:00100000:1.0:1787383189.231075:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787383189.231085:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984792832:12345-0@lo:501: 00000100:00100000:1.0:1787383189.231225:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984792832:12345-0@lo:501: Request processed in 141us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.231234:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787383189.231265:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984792832:0@lo:501: 00000100:00100000:3.0:1787383189.231320:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984792960:0@lo:503: 00000100:00100000:3.0:1787383189.231364:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.231405:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a37000 going to sleep for 11 seconds 00000100:00100000:0.0:1787383189.231824:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984792960 00000100:00100000:0.0:1787383189.231830:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984792960 00000100:00100000:3.0:1787383189.231915:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787383189.231924:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984792960:12345-0@lo:503: 00000100:00100000:3.0:1787383189.232033:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984792960:12345-0@lo:503: Request processed in 110us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.232040:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787383189.232544:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984792960:0@lo:503: 00000001:00100000:2.0:1787383189.235439:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787383189.236663:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8909:x1874206984791680:12345-0@lo:700: Request processed in 38245us (40440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.236682:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787383189.236861:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da09f80 x1874206984791680/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787383205 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383189.236887:0:8909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1874206984791680:0@lo:700: 00000100:00100000:0.0:1787383189.238641:0:8911:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8911:1874206984793088:0@lo:502: 00000100:00100000:0.0:1787383189.238729:0:8911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383189.238948:0:8911:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383189.238999:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984793088 00000100:00100000:1.0:1787383189.239007:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984793088 00000100:00100000:1.0:1787383189.239095:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787383189.239104:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+20:8911:x1874206984793088:12345-0@lo:502: 00000100:00100000:1.0:1787383189.239231:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+20:8911:x1874206984793088:12345-0@lo:502: Request processed in 128us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.239239:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787383189.239325:0:8911:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8911:1874206984793088:0@lo:502: 00000020:01000000:0.0:1787383189.239358:0:8911:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787383189.239366:0:8911:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787383189.239372:0:8911:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383189.239374:0:8911:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787383189.239379:0:8911:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787383189.239384:0:8911:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:0.0:1787383189.239422:0:8911:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787383189.239426:0:8911:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383189.239441:0:8911:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9636351b3380) 00000020:00000080:0.0:1787383189.239462:0:8911:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1787383189.239468:0:8911:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787383189.239574:0:8911:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787383189.239580:0:8911:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787383189.239587:0:8911:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532e305 00010000:00080000:0.0:1787383189.239615:0:8911:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9636313f2800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1787383189.239866:0:8911:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1787383189.242406:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984793216:0@lo:13: 00000100:00100000:0.0:1787383189.242469:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787383189.242521:0:8909:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787383189.242743:0:8909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1874206984793344:0@lo:7: 00000100:00100000:2.0:1787383189.242798:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383189.242843:0:8909:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397240 going to sleep for 11 seconds 00000100:00100000:0.0:1787383189.242964:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984793344 00000100:00100000:0.0:1787383189.242972:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984793344 00000100:00100000:0.0:1787383189.243022:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383189.243031:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8909:x1874206984793344:12345-0@lo:7: 00000040:01000000:2.0:1787383189.245447:0:8911:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787383189.245470:0:8911:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787383189.245860:0:8911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383189.246059:0:8911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383189.246146:0:8911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787383189.246229:0:8911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787383189.248078:0:8912:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383189.248085:0:8912:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1787383189.248280:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984793216 00000100:00100000:1.0:1787383189.248290:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984793216 00000100:00100000:1.0:1787383189.248342:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383189.248352:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874206984793216:12345-0@lo:13: 00002000:00000024:1.0:1787383189.248380:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923881984 avail 3692359680 00000100:00100000:1.0:1787383189.248459:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874206984793216:12345-0@lo:13: Request processed in 108us (5988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.248467:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787383189.248515:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963502069500 x1874206984793216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383189.248533:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984793216:0@lo:13: 00000020:00000080:3.0:1787383189.249237:0:8911:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787383189.249252:0:8911:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787383189.249290:0:8911:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787383189.249312:0:8911:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532e30c 00000100:00080000:3.0:1787383189.249319:0:8911:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787383189.249324:0:8911:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9636313f2800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383189.249351:0:8911:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362da09500 x1874206984793472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383189.249410:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984793472:0@lo:8: 00000100:00100000:2.0:1787383189.249460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787383189.249521:0:8911:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787383189.249576:0:8911:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383189.249581:0:8911:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383189.249584:0:8911:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787383189.249586:0:8911:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383189.249590:0:8911:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383189.249600:0:8911:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787383189.249604:0:8911:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787383189.249605:0:8911:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787383189.249627:0:8911:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8911:1874206984793600:0@lo:502: 00000100:00100000:3.0:1787383189.249666:0:8911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.249687:0:8911:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383189.249786:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984793600 00000100:00100000:0.0:1787383189.249792:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984793600 00000100:00100000:0.0:1787383189.249835:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787383189.249842:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+20:8911:x1874206984793600:12345-0@lo:502: 00000100:00100000:0.0:1787383189.249954:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+20:8911:x1874206984793600:12345-0@lo:502: Request processed in 112us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383189.249965:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787383189.250940:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787383189.250950:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787383189.251063:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984793472 00000100:00100000:1.0:1787383189.251069:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984793472 00000100:00100000:1.0:1787383189.251199:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383189.251205:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1874206984793472:12345-0@lo:8: 00010000:00080000:1.0:1787383189.251232:0:8914:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1787383189.251259:0:8914:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532e313 00002000:00100000:1.0:1787383189.251272:0:8914:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96363db9b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787383189.251276:0:8914:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787383189.251279:0:8914:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787383189.251331:0:8914:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787383189.251353:0:8914:0:(import.c:65:import_set_state_nolock()) ffff96363db9e800 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1787383189.252627:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787383189.252633:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787383189.252699:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8909:x1874206984793344:12345-0@lo:7: Request processed in 9667us (9898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383189.252707:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383189.252762:0:8911:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:8911:1874206984793600:0@lo:502: 00000020:01000000:0.0:1787383189.252830:0:8911:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383189.252837:0:8911:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383189.252839:0:8911:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787383189.252844:0:8911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:3.0:1787383189.253108:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963502068000 x1874206984793344/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787383205 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383189.253121:0:8909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1874206984793344:0@lo:7: 00000004:00080000:3.0:1787383189.253129:0:8909:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787383189.253162:0:8909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1874206984793728:0@lo:5: 00000100:00100000:3.0:1787383189.253195:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.253225:0:8909:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a37780 going to sleep for 11 seconds 00000100:00100000:0.0:1787383189.253324:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984793728 00000100:00100000:0.0:1787383189.253329:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984793728 00000100:00100000:0.0:1787383189.253370:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383189.253378:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8909:x1874206984793728:12345-0@lo:5: 00002000:00080000:0.0:1787383189.253400:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1787383189.253436:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8909:x1874206984793728:12345-0@lo:5: Request processed in 58us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383189.253442:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787383189.253465:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da08e00 x1874206984793728/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383205 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383189.253474:0:8909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1874206984793728:0@lo:5: 00000004:00080000:0.0:1787383189.253480:0:8909:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787383189.253502:0:8909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1874206984793856:0@lo:5: 00000100:00100000:0.0:1787383189.253524:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383189.253538:0:8909:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91480 going to sleep for 11 seconds 00000100:00100000:0.0:1787383189.253556:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984793856 00000100:00100000:0.0:1787383189.253560:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984793856 00000100:00100000:0.0:1787383189.253585:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787383189.253591:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8909:x1874206984793856:12345-0@lo:5: 00002000:00080000:0.0:1787383189.253613:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787383189.255053:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1874206984793472:12345-0@lo:8: Request processed in 3842us (5587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383189.255063:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:1.0:1787383189.255096:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787383189.255126:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787383189.255137:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.255147:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e2f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383189.255158:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787383189.255161:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9636345a8000 from 1 10000000:01000000:1.0:1787383189.255163:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787383189.255194:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.255202:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.255211:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383189.255229:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502014a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984793984:0@lo:101: 00000100:00100000:1.0:1787383189.255279:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.255318:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636064c60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383189.255379:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984793984 00000100:00100000:3.0:1787383189.255387:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984793984 00000100:00100000:3.0:1787383189.255433:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787383189.255441:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984793984:12345-0@lo:101: 00010000:00010000:3.0:1787383189.255452:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383189.255465:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963601654600/0xc40acec91532e321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e31a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.255488:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963601654600/0xc40acec91532e321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e31a expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.255499:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963601654600/0xc40acec91532e321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e31a expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383189.255508:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601654600, rc 0) 00000100:00100000:3.0:1787383189.255543:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984793984:12345-0@lo:101: Request processed in 103us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.255556:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787383189.255792:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502014a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984793984:0@lo:101: 00010000:00010000:1.0:1787383189.255807:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e321 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.255827:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e321 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383189.255905:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502014a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984794112:0@lo:501: 00000100:00100000:1.0:1787383189.255934:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383189.255954:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636064c60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383189.256126:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984794112 00000100:00100000:3.0:1787383189.256131:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984794112 00000100:00100000:3.0:1787383189.256162:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787383189.256169:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984794112:12345-0@lo:501: 00000100:00100000:3.0:1787383189.256244:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984794112:12345-0@lo:501: Request processed in 74us (309us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787383189.256250:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787383189.256316:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502014a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984794112:0@lo:501: 10000000:01000000:1.0:1787383189.256340:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787383189.256346:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e321 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383189.256353:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e321 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383189.259181:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8909:x1874206984793856:12345-0@lo:5: Request processed in 5583us (5649us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787383189.259192:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787383189.259522:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da09500 x1874206984793472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383189.259533:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787383189.259542:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787383189.259550:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787383189.259555:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787383189.259558:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9636313f2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787383189.259630:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787383189.259638:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984793472:0@lo:8: 00000004:00080000:1.0:1787383189.259709:0:8912:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787383189.259806:0:8912:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 222288039577ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787383189.259812:0:8912:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:3.0:1787383189.261431:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9636409a5c00 x1874206984793856/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383205 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383189.261449:0:8909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1874206984793856:0@lo:5: 00000004:00080000:3.0:1787383189.261464:0:8909:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1787383189.261506:0:8909:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8909:1874206984794240:0@lo:900: 00000100:00100000:3.0:1787383189.261575:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.261606:0:8909:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a37000 going to sleep for 11 seconds 00000100:00100000:2.0:1787383189.261986:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984794240 00000100:00100000:2.0:1787383189.261993:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984794240 00000100:00100000:2.0:1787383189.262042:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383189.262051:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8909:x1874206984794240:12345-0@lo:900: 00000100:00100000:2.0:1787383189.262120:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8909:x1874206984794240:12345-0@lo:900: Request processed in 69us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383189.262127:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:2.0:1787383189.262351:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:3.0:1787383189.262602:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da0ad80 x1874206984794240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787383205 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383189.262615:0:8909:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8909:1874206984794240:0@lo:900: 00000100:00100000:0.0:1787383189.265843:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383189.265866:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984794368:0@lo:13: 00000100:00100000:0.0:1787383189.265949:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383189.266001:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984794368 00000100:00100000:0.0:1787383189.266009:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984794368 00000100:00100000:0.0:1787383189.266061:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383189.266069:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874206984794368:12345-0@lo:13: 00002000:00000024:0.0:1787383189.266090:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1787383189.266127:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874206984794368:12345-0@lo:13: Request processed in 59us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383189.266134:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787383189.266152:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787383189.266178:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9636409a5880 x1874206984794368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383189.266196:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984794368:0@lo:13: 00000004:00080000:0.0:1787383189.266215:0:8913:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787383189.266232:0:8913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1874206984794496:0@lo:7: 00000100:00100000:0.0:1787383189.266280:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383189.266306:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984794496 00000100:00100000:0.0:1787383189.266315:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984794496 00000100:00100000:0.0:1787383189.266339:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383189.266345:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8913:x1874206984794496:12345-0@lo:7: 00000100:00100000:2.0:1787383189.273456:0:8913:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605301900 going to sleep for 11 seconds 00002000:00080000:0.0:1787383189.275115:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787383189.275123:0:8435:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787383189.275274:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8913:x1874206984794496:12345-0@lo:7: Request processed in 8923us (8988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383189.275285:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787383189.275366:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9636409a5880 x1874206984794496/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787383205 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383189.275394:0:8913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1874206984794496:0@lo:7: 00000004:00080000:2.0:1787383189.275409:0:8913:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787383189.275448:0:8913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1874206984794624:0@lo:5: 00000100:00100000:2.0:1787383189.275482:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383189.275542:0:8913:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636113973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383189.275638:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984794624 00000100:00100000:1.0:1787383189.275645:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984794624 00000100:00100000:1.0:1787383189.275719:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787383189.275729:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8913:x1874206984794624:12345-0@lo:5: 00002000:00080000:1.0:1787383189.275753:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787383189.275757:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1787383189.279762:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1787383189.279909:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787383189.279917:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787383189.280250:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8913:x1874206984794624:12345-0@lo:5: Request processed in 4519us (4764us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787383189.280284:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787383189.280365:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96350206ad80 x1874206984794624/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383205 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383189.280376:0:8913:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787383189.280383:0:8913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1874206984794624:0@lo:5: 00000004:00080000:3.0:1787383189.280396:0:8913:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787383189.280451:0:8913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1874206984794752:0@lo:700: 00000100:00100000:3.0:1787383189.280487:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.280547:0:8913:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a37000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383189.280593:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984794752 00000100:00100000:1.0:1787383189.280599:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984794752 00000100:00100000:1.0:1787383189.280677:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383189.280688:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8913:x1874206984794752:12345-0@lo:700: 00000100:00100000:3.0:1787383189.290969:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8913:x1874206984794752:12345-0@lo:700: Request processed in 10275us (10473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383189.290984:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787383189.291085:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da0ad80 x1874206984794752/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787383205 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383189.291100:0:8913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1874206984794752:0@lo:700: 00000004:02000040:3.0:1787383189.292452:0:8913:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1787383189.297094:0:8913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1874206984794880:0@lo:5: 00000100:00100000:3.0:1787383189.297166:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383189.297288:0:8913:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a37000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383189.297556:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984794880 00000100:00100000:1.0:1787383189.297564:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984794880 00000100:00100000:1.0:1787383189.297676:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787383189.297685:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8913:x1874206984794880:12345-0@lo:5: 00002000:00080000:1.0:1787383189.302476:0:8914:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787383189.302495:0:8914:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1787383189.305232:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8913:x1874206984794880:12345-0@lo:5: Request processed in 7541us (8059us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787383189.305245:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787383189.305323:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da09880 x1874206984794880/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383205 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383189.305339:0:8913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1874206984794880:0@lo:5: 00000004:00080000:3.0:1787383189.305352:0:8913:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000001:00080000:0.0:1787383189.404129:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000020:00000004:2.0:1787383190.153699:0:8964:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383190.154648:0:8964:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787383190.171987:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787383191.103003:0:9012:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383191.103013:0:9012:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1787383191.194889:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383191.707942:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984795008:0@lo:41: 00000100:00100000:1.0:1787383191.708007:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383191.708115:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984795008 00000100:00100000:3.0:1787383191.708123:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984795008 00000100:00100000:3.0:1787383191.708174:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787383191.708192:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984795008:12345-0@lo:41: 00000004:00000024:3.0:1787383191.708225:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787383191.708279:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984795008:12345-0@lo:41: Request processed in 97us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383191.708286:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787383191.708361:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984795008:0@lo:41: 00010000:00010000:1.0:1787383192.221633:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383193.244001:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383193.756017:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984795136:0@lo:41: 00000100:00100000:1.0:1787383193.756088:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383193.756216:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984795136 00000100:00100000:3.0:1787383193.756224:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984795136 00000100:00100000:3.0:1787383193.756291:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787383193.756300:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984795136:12345-0@lo:41: 00000004:00000024:3.0:1787383193.756343:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787383193.756394:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984795136:12345-0@lo:41: Request processed in 94us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383193.756402:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787383193.756593:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984795136:0@lo:41: 00000100:00100000:1.0:1787383194.266949:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984795264:0@lo:13: 00000100:00100000:3.0:1787383194.266993:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984795392:0@lo:400: 00000100:00100000:1.0:1787383194.267012:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383194.267023:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383194.267066:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984795776:0@lo:400: 00000100:00100000:1.0:1787383194.267091:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383194.267109:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984796288:0@lo:400: 00000100:00100000:1.0:1787383194.267130:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383194.267160:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787383194.267166:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984795648:0@lo:400: 00000100:00100000:1.0:1787383194.267190:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383194.267208:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984796160:0@lo:400: 00000100:00100000:1.0:1787383194.267228:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383194.267258:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984795264 00000100:00100000:1.0:1787383194.267266:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984795264 00000100:00100000:1.0:1787383194.267315:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383194.267324:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984795264:12345-0@lo:13: 00002000:00000024:1.0:1787383194.267360:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383194.267400:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984795264:12345-0@lo:13: Request processed in 76us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383194.267605:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383194.267629:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984795392 00000100:00100000:1.0:1787383194.267633:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984795392 00000100:00100000:1.0:1787383194.267658:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787383194.267664:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:3649:x1874206984795392:12345-0@lo:400: 00000100:00100000:1.0:1787383194.267697:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:3649:x1874206984795392:12345-0@lo:400: Request processed in 32us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383194.267703:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787383194.267729:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984795776 00000100:00100000:1.0:1787383194.267733:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984795776 00000100:00100000:1.0:1787383194.267756:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984796160 00000100:00100000:1.0:1787383194.267759:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984796160 00000100:00100000:1.0:1787383194.267798:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787383194.267804:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984795776:12345-0@lo:400: 00000100:00100000:1.0:1787383194.267856:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984795776:12345-0@lo:400: Request processed in 51us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383194.267862:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787383194.267874:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787383194.267880:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984796160:12345-0@lo:400: 00000100:00100000:1.0:1787383194.267908:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984796160:12345-0@lo:400: Request processed in 28us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383194.267914:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787383194.267932:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984796288 00000100:00100000:1.0:1787383194.267935:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984796288 00000100:00100000:1.0:1787383194.268080:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383194.268086:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984796288:12345-0@lo:400: 00000100:00100000:1.0:1787383194.268113:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984796288:12345-0@lo:400: Request processed in 28us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383194.268125:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383194.268205:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984795648 00000100:00100000:1.0:1787383194.268209:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984795648 00000100:00100000:1.0:1787383194.268234:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787383194.268240:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984795648:12345-0@lo:400: 00000100:00100000:1.0:1787383194.268269:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984795648:12345-0@lo:400: Request processed in 30us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383194.268275:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787383194.268294:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383194.268298:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383194.268334:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984795648:0@lo:400: 00010000:00080000:1.0:1787383194.268523:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da08000 x1874206984796160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383194.268538:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984796160:0@lo:400: 00010000:00080000:1.0:1787383194.268552:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da0ad80 x1874206984795776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383194.268561:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984795776:0@lo:400: 00010000:00080000:1.0:1787383194.268570:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da09f80 x1874206984796288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383194.268577:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787383194.268591:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984796288:0@lo:400: 00010000:00080000:1.0:1787383194.268599:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963502016680 x1874206984795264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383194.268612:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984795264:0@lo:13: 00000100:00100000:1.0:1787383194.268667:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984795520:0@lo:400: 00000100:00100000:1.0:1787383194.268694:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383194.268713:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984796032:0@lo:400: 00000100:00100000:1.0:1787383194.268732:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383194.268757:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984795520 00000100:00100000:1.0:1787383194.268761:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984795520 00000100:00100000:1.0:1787383194.268811:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984796032 00000100:00100000:1.0:1787383194.268814:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984796032 00000100:00100000:1.0:1787383194.268831:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787383194.268836:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984795520:12345-0@lo:400: 00000100:00100000:1.0:1787383194.268880:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984795520:12345-0@lo:400: Request processed in 43us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383194.268887:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787383194.268902:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787383194.268909:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984796032:12345-0@lo:400: 00000100:00100000:1.0:1787383194.268932:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984796032:12345-0@lo:400: Request processed in 24us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383194.269112:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787383194.269133:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787383194.269223:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da0a680 x1874206984795520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383194.269231:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984795520:0@lo:400: 00010000:00080000:1.0:1787383194.269241:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da08e00 x1874206984796032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383194.269248:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984796032:0@lo:400: 00010000:00010000:0.0:1787383194.269562:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383194.271632:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984795392:0@lo:400: 00000100:00100000:3.0:1787383194.271649:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984795904:0@lo:400: 00000100:00100000:3.0:1787383194.271795:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383194.271938:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984796416:0@lo:400: 00000100:00100000:3.0:1787383194.271968:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383194.272061:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984796544:0@lo:13: 00000100:00100000:3.0:1787383194.272086:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383194.272181:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984796544 00000100:00100000:3.0:1787383194.272188:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984796544 00000100:00100000:3.0:1787383194.272239:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383194.272247:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984796544:12345-0@lo:13: 00002000:00000024:3.0:1787383194.272268:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383194.272306:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984796544:12345-0@lo:13: Request processed in 59us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383194.272313:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787383194.272334:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787383194.272353:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da0b100 x1874206984796544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383194.272383:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1787383194.272397:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984796544:0@lo:13: 00000100:00100000:3.0:1787383194.272458:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984796416 00000100:00100000:3.0:1787383194.272462:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984796416 00000100:00100000:3.0:1787383194.272492:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383194.272498:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984796416:12345-0@lo:400: 00000100:00100000:3.0:1787383194.272546:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984796416:12345-0@lo:400: Request processed in 36us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383194.272553:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787383194.272578:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da0bb80 x1874206984796416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383194.272587:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984796416:0@lo:400: 00000100:00100000:1.0:1787383194.275899:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984795904 00000100:00100000:1.0:1787383194.275914:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984795904 00000100:00100000:1.0:1787383194.276029:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787383194.276042:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984795904:12345-0@lo:400: 00000100:00100000:1.0:1787383194.276137:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984795904:12345-0@lo:400: Request processed in 99us (4343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383194.276147:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787383194.276266:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984795904:0@lo:400: 00010000:00010000:3.0:1787383195.292997:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383196.315016:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383196.827933:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984796672:0@lo:41: 00000100:00100000:1.0:1787383196.828005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383196.828135:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984796672 00000100:00100000:2.0:1787383196.828143:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984796672 00000100:00100000:2.0:1787383196.828186:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787383196.828195:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984796672:12345-0@lo:41: 00000004:00000024:2.0:1787383196.828226:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787383196.828267:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984796672:12345-0@lo:41: Request processed in 74us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383196.828284:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787383196.829242:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984796672:0@lo:41: 00010000:00010000:3.0:1787383197.339943:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383198.368074:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383198.881442:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984796800:0@lo:41: 00000100:00100000:1.0:1787383198.881515:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383198.881607:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984796800 00000100:00100000:1.0:1787383198.881615:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984796800 00000100:00100000:1.0:1787383198.881956:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787383198.881967:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984796800:12345-0@lo:41: 00000004:00000024:1.0:1787383198.882342:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787383198.882398:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984796800:12345-0@lo:41: Request processed in 433us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383198.882406:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787383198.882461:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984796800:0@lo:41: 00010000:00010000:0.0:1787383199.386975:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383199.388099:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984796928:0@lo:13: 00000100:00100000:3.0:1787383199.388176:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383199.388272:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984796928 00000100:00100000:3.0:1787383199.388280:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984796928 00000100:00100000:3.0:1787383199.388328:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383199.388338:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984796928:12345-0@lo:13: 00002000:00000024:3.0:1787383199.388367:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383199.388405:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984796928:12345-0@lo:13: Request processed in 70us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383199.388412:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787383199.388437:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787383199.388467:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da09500 x1874206984796928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383199.388484:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984796928:0@lo:13: 00000100:00100000:3.0:1787383199.388751:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984797056:0@lo:400: 00000100:00100000:0.0:1787383199.388801:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984797184:0@lo:400: 00000100:00100000:3.0:1787383199.388817:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383199.388847:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984797568:0@lo:400: 00000100:00100000:0.0:1787383199.388855:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383199.388895:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984797696:0@lo:400: 00000100:00100000:0.0:1787383199.388918:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383199.388941:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787383199.388947:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984797312:0@lo:400: 00000100:00100000:0.0:1787383199.388974:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383199.388997:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984797824:0@lo:400: 00000100:00100000:0.0:1787383199.389039:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383199.389089:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984797184 00000100:00100000:1.0:1787383199.389099:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984797696 00000100:00100000:0.0:1787383199.389100:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984797184 00000100:00100000:1.0:1787383199.389108:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984797696 00000100:00100000:0.0:1787383199.389130:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984797824 00000100:00100000:0.0:1787383199.389134:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984797824 00000100:00100000:1.0:1787383199.389151:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787383199.389161:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984797184:12345-0@lo:400: 00000100:00100000:1.0:1787383199.389205:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f994700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984797184:12345-0@lo:400: Request processed in 47us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383199.389289:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383199.389313:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984798080:0@lo:13: 00000100:00100000:3.0:1787383199.389337:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383199.389352:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787383199.389358:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984797440:0@lo:400: 00000100:00100000:3.0:1787383199.389376:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383199.389384:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984797952:0@lo:400: 00000100:00100000:3.0:1787383199.389397:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383199.389418:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984797056 00000100:00100000:3.0:1787383199.389421:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984797056 00000100:00100000:3.0:1787383199.389441:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787383199.389446:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:3650:x1874206984797056:12345-0@lo:400: 00000100:00100000:3.0:1787383199.389471:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:3650:x1874206984797056:12345-0@lo:400: Request processed in 25us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383199.389476:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787383199.389502:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984798080 00000100:00100000:3.0:1787383199.389505:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984798080 00000100:00100000:3.0:1787383199.389526:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383199.389532:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984798080:12345-0@lo:13: 00002000:00000024:3.0:1787383199.389549:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383199.389574:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984798080:12345-0@lo:13: Request processed in 43us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383199.389579:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787383199.389612:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963502017100 x1874206984798080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383199.389626:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984798080:0@lo:13: 00000100:00100000:3.0:1787383199.389636:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984797056:0@lo:400: 00000100:00100000:0.0:1787383199.389963:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787383199.389972:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787383199.389990:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787383199.389995:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984797440 00000100:00100000:0.0:1787383199.389999:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984797440 00000100:00100000:0.0:1787383199.390501:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787383199.390513:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787383199.390522:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984797696:12345-0@lo:400: 00000100:00100000:0.0:1787383199.390572:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984797696:12345-0@lo:400: Request processed in 52us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383199.390579:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787383199.390844:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787383199.390854:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787383199.390861:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984797824:12345-0@lo:400: 00000100:00100000:1.0:1787383199.391022:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787383199.391042:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787383199.391050:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787383199.391058:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984797440:12345-0@lo:400: 00000100:00100000:1.0:1787383199.391114:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984797440:12345-0@lo:400: Request processed in 58us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.391121:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787383199.391168:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984797312 00000100:00100000:1.0:1787383199.391174:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984797312 00000100:00100000:1.0:1787383199.391197:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984797568 00000100:00100000:1.0:1787383199.391199:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984797568 00000100:00100000:1.0:1787383199.391214:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787383199.391221:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984797312:12345-0@lo:400: 00010000:00080000:3.0:1787383199.391276:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363f994000 x1874206984797440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383199.391289:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984797440:0@lo:400: 00000100:00100000:1.0:1787383199.391498:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984797312:12345-0@lo:400: Request processed in 277us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.391506:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787383199.391525:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787383199.391531:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984797568:12345-0@lo:400: 00000100:00100000:1.0:1787383199.391573:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984797568:12345-0@lo:400: Request processed in 43us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.391580:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787383199.391601:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984797952 00000100:00100000:1.0:1787383199.391605:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984797952 00000100:00100000:1.0:1787383199.391632:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383199.391638:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984797952:12345-0@lo:400: 00000100:00100000:1.0:1787383199.391675:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984797952:12345-0@lo:400: Request processed in 37us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.391695:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787383199.391721:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383199.391726:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383199.391729:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787383199.391827:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363f997800 x1874206984797952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383199.391840:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984797824:12345-0@lo:400: Request processed in 977us (2796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383199.391841:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984797952:0@lo:400: 00000100:00100000:0.0:1787383199.391856:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787383199.391865:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984797568:0@lo:400: 00000100:00100000:0.0:1787383199.392202:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984797312:0@lo:400: 00010000:00080000:0.0:1787383199.392216:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363f996d80 x1874206984797824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383199.392227:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984797824:0@lo:400: 00010000:00080000:0.0:1787383199.392240:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363f997b80 x1874206984797184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383199.392249:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984797184:0@lo:400: 00010000:00080000:0.0:1787383199.392274:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363f995180 x1874206984797696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383199.392282:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984797696:0@lo:400: 00000020:01000004:3.0:1787383199.547180:0:9512:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787383199.547184:0:9512:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787383199.547185:0:9512:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787383199.547319:0:9512:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff96350233b000 00000020:01000004:3.0:1787383199.547334:0:9512:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787383199.547348:0:9512:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787383199.547370:0:9512:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96350273b380) 00000020:00000080:3.0:1787383199.547387:0:9512:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787383199.598353:0:9512:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787383199.598726:0:9512:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1787383199.623096:0:9512:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787383199.623303:0:9512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787383199.623316:0:9512:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787383199.623330:0:9512:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc40acec91532e32f 00000020:01000004:3.0:1787383199.623336:0:9512:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787383199.623356:0:9512:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787383199.623359:0:9512:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787383199.623364:0:9512:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787383199.623390:0:9512:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787383199.623394:0:9512:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787383199.645353:0:9512:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787383199.645394:0:9512:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.102@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787383199.645398:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787383199.645400:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787383199.645402:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383199.645403:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383199.645404:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383199.645406:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383199.645407:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383199.645408:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787383199.645410:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787383199.645412:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383199.645413:0:9512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787383199.645417:0:9512:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787383199.645419:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787383199.645421:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787383199.645422:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383199.645423:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383199.645424:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383199.645425:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383199.645426:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383199.645427:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787383199.645428:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787383199.645429:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383199.645430:0:9512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787383199.645455:0:9512:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787383199.645472:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984798208:0@lo:253: 00000100:00100000:3.0:1787383199.645748:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383199.645826:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984798208 00000100:00100000:3.0:1787383199.645841:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984798208 00000100:00100000:3.0:1787383199.645886:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787383199.645895:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:9512:x1874206984798208:12345-0@lo:253: 20000000:01000000:3.0:1787383199.645926:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787383199.645931:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787383199.645935:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787383199.645939:0:6514:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787383199.646156:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383199.646378:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1787383199.646396:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787383199.646418:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1787383199.646425:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787383199.646439:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1787383199.646452:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1787383199.646814:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1787383199.646838:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.102@tcp 20000000:01000000:3.0:1787383199.646840:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:3.0:1787383199.646862:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1787383199.646872:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787383199.646887:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1787383199.646893:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:3.0:1787383199.646907:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1787383199.646914:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787383199.646927:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1787383199.646944:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1787383199.647029:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1787383199.647043:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.102@tcp 20000000:01000000:3.0:1787383199.647045:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:3.0:1787383199.647077:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1787383199.647085:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787383199.647100:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1787383199.647115:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:3.0:1787383199.647132:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1787383199.647139:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787383199.647151:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1787383199.647166:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1787383199.647850:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1787383199.647866:0:6514:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.102@tcp 20000000:01000000:3.0:1787383199.647867:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.102@tcp (null) (null) (null) 00000040:00080000:3.0:1787383199.647880:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1787383199.647885:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787383199.647896:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1787383199.647900:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.102@tcp (null) (null) 00000040:00080000:3.0:1787383199.647910:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1787383199.647916:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787383199.647926:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1787383199.647938:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1787383199.647949:0:6514:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787383199.647951:0:6514:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787383199.647955:0:6514:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787383199.647993:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787383199.647995:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000100:00100000:3.0:1787383199.648568:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636064c6540 going to sleep for 11 seconds 20000000:01000000:2.0:1787383199.654045:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1787383199.654130:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1787383199.654143:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787383199.654300:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787383199.654324:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1787383199.654338:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1787383199.654347:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787383199.654349:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787383199.655502:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1787383199.655533:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1787383199.655556:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1787383199.655738:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1787383199.655802:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1787383199.655840:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1787383199.655852:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787383199.655854:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787383199.656626:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1787383199.659336:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1787383199.659376:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1787383199.659392:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1787383199.659406:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1787383199.659408:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787383199.663065:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1787383199.663115:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1787383199.663134:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1787383199.663350:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1787383199.663374:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1787383199.663388:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1787383199.663399:0:6514:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787383199.663402:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787383199.664099:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1787383199.664125:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1787383199.664142:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1787383199.664358:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1787383199.664380:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1787383199.664396:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:0.0:1787383199.664411:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787383199.664431:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.664449:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636102b6200/0xc40acec91532e22c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e225 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.664457:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636352c1200/0xc40acec91532e256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e24f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.664463:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c9a00/0xc40acec91532e295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e28e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.664469:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963601655c00/0xc40acec91532e2b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e2aa expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.664488:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636352c0000/0xc40acec91532e2db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e2d4 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.664495:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963601655600/0xc40acec91532e2f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e2f0 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.664502:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963601654600/0xc40acec91532e321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e31a expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.664509:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.664545:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963601654600/0xc40acec91532e321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e31a expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.664560:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff963601654600/0xc40acec91532e321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e31a expref: 21 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.664574:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984798336:0@lo:104: 00000100:00100000:0.0:1787383199.664640:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383199.664726:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963601655600/0xc40acec91532e2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e2f0 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.664735:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff963601655600/0xc40acec91532e2f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e2f0 expref: 21 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.664744:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f996d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984798464:0@lo:104: 00000100:00100000:0.0:1787383199.664890:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383199.664991:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636352c0000/0xc40acec91532e2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e2d4 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.665007:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636352c0000/0xc40acec91532e2db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e2d4 expref: 21 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.665016:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984798592:0@lo:104: 00000100:00100000:0.0:1787383199.665045:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.665067:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984798336 00000100:00100000:2.0:1787383199.665074:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984798336 00000100:00100000:2.0:1787383199.665108:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984798464 00000100:00100000:2.0:1787383199.665111:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984798464 00000100:00100000:2.0:1787383199.665125:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383199.665132:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+4:6514:x1874206984798336:12345-0@lo:104: 00010000:00010000:2.0:1787383199.665145:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e321 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.665191:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787383199.665197:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+4:6514:x1874206984798336:12345-0@lo:104: Request processed in 66us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383199.665203:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383199.665218:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383199.665223:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f995500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+3:6514:x1874206984798464:12345-0@lo:104: 00010000:00010000:2.0:1787383199.665229:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e2f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.665273:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787383199.665278:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f995500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+3:6514:x1874206984798464:12345-0@lo:104: Request processed in 55us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383199.665293:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1787383199.665310:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383199.665315:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e321 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.665322:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383199.665325:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e321 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.665333:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e321 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383199.665340:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e321 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383199.665345:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383199.665368:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e321 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.665374:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383199.665395:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e321 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.665402:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e31a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e321 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.665413:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383199.665416:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e2f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.665431:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1600 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383199.665434:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e2f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.665440:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e2f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383199.665446:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e2f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383199.665450:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383199.665462:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.665467:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383199.665473:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.665478:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c1600/0xc40acec91532e2f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.665486:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383199.665487:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383199.665489:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383199.665525:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383199.665888:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984798720:0@lo:103: 00000100:00100000:1.0:1787383199.665925:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383199.665959:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383199.665966:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984798848:0@lo:103: 00000100:00100000:1.0:1787383199.666002:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383199.666031:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984798720 00000100:00100000:1.0:1787383199.666036:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984798720 00010000:00010000:1.0:1787383199.666056:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963601654600/0xc40acec91532e321 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e31a expref: 22 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383199.666077:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984798848 00000100:00100000:1.0:1787383199.666080:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984798848 00010000:00010000:1.0:1787383199.666091:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963601655600/0xc40acec91532e2f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e2f0 expref: 23 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383199.666124:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787383199.666130:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502017800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+23:3647:x1874206984798720:12345-0@lo:103: 00010000:00010000:1.0:1787383199.666140:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383199.666144:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963601654600/0xc40acec91532e321 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e31a expref: 23 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.666153:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963601654600/0xc40acec91532e321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e31a expref: 23 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.666170:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383199.666199:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502017800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+23:3647:x1874206984798720:12345-0@lo:103: Request processed in 69us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.666204:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787383199.666224:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787383199.666230:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502017100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+22:3647:x1874206984798848:12345-0@lo:103: 00010000:00010000:1.0:1787383199.666237:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383199.666241:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963601655600/0xc40acec91532e2f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e2f0 expref: 22 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.666263:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963601655600/0xc40acec91532e2f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e2f0 expref: 22 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.666273:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383199.666295:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502017100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+22:3647:x1874206984798848:12345-0@lo:103: Request processed in 65us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.666301:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787383199.666336:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984798848:0@lo:103: 00000100:00100000:1.0:1787383199.666352:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984798720:0@lo:103: 00010000:00010000:0.0:1787383199.666944:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963601655c00/0xc40acec91532e2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e2aa expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.666956:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff963601655c00/0xc40acec91532e2b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e2aa expref: 21 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.666966:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984798976:0@lo:104: 00000100:00100000:0.0:1787383199.666997:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383199.667028:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c9a00/0xc40acec91532e295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e28e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.667036:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636113c9a00/0xc40acec91532e295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e28e expref: 21 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.667045:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984799104:0@lo:104: 00000100:00100000:0.0:1787383199.667067:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383199.667083:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636352c1200/0xc40acec91532e256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e24f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.667090:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636352c1200/0xc40acec91532e256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e24f expref: 21 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.667098:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984799232:0@lo:104: 00000100:00100000:0.0:1787383199.667131:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383199.667147:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636102b6200/0xc40acec91532e22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e225 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.667155:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636102b6200/0xc40acec91532e22c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e225 expref: 21 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.667162:0:6514:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984799360:0@lo:104: 00000100:00100000:0.0:1787383199.667177:0:6514:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051460c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787383199.667194:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963601654600/0xc40acec91532e321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e31a expref: 21 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.667204:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984798336:0@lo:104: 00010000:00010000:0.0:1787383199.667215:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963601655600/0xc40acec91532e2f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e2f0 expref: 20 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.667223:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f996d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984798464:0@lo:104: 00000100:00100000:2.0:1787383199.667277:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787383199.667295:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.667304:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984798592 00000100:00100000:2.0:1787383199.667308:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984798592 00000100:00100000:2.0:1787383199.667331:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984798976 00000100:00100000:2.0:1787383199.667341:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984798976 00000100:00100000:2.0:1787383199.667355:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984799104 00000100:00100000:2.0:1787383199.667358:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984799104 00000100:00100000:2.0:1787383199.667365:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984799232 00000100:00100000:2.0:1787383199.667367:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984799232 00000100:00100000:2.0:1787383199.667374:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984799360 00000100:00100000:2.0:1787383199.667376:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984799360 00000100:00100000:2.0:1787383199.667385:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383199.667391:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f996680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+7:6514:x1874206984798592:12345-0@lo:104: 00010000:00010000:2.0:1787383199.667402:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e2db expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.667455:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787383199.667461:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f996680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+7:6514:x1874206984798592:12345-0@lo:104: Request processed in 70us (2415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383199.667467:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383199.667482:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787383199.667488:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f994380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+6:6514:x1874206984798976:12345-0@lo:104: 00010000:00010000:2.0:1787383199.667494:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.667523:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787383199.667528:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f994380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+6:6514:x1874206984798976:12345-0@lo:104: Request processed in 41us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383199.667533:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787383199.667545:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787383199.667550:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f997800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+5:6514:x1874206984799104:12345-0@lo:104: 00010000:00010000:2.0:1787383199.667557:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.667593:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787383199.667597:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f997800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+5:6514:x1874206984799104:12345-0@lo:104: Request processed in 48us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383199.667602:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787383199.667614:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787383199.667619:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635024c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+4:6514:x1874206984799232:12345-0@lo:104: 00010000:00010000:2.0:1787383199.667626:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e256 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.667651:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787383199.667656:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635024c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+4:6514:x1874206984799232:12345-0@lo:104: Request processed in 38us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383199.667661:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787383199.667687:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787383199.667694:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+3:6514:x1874206984799360:12345-0@lo:104: 00010000:00010000:2.0:1787383199.667701:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e22c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.667725:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787383199.667729:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+3:6514:x1874206984799360:12345-0@lo:104: Request processed in 37us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383199.667733:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787383199.667828:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787383199.667834:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e2db expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.667841:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654000 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383199.667844:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e2db expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.667852:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e2db expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383199.667858:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e2db expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383199.667863:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383199.667909:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2db expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.667917:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383199.667935:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2db expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.667942:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601654000/0xc40acec91532e2d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2db expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.667952:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787383199.667955:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.667971:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0600 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383199.667974:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.667981:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383199.667986:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383199.667991:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383199.668005:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668011:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383199.668017:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668023:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e2aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668031:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787383199.668034:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668040:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b6400 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383199.668042:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668059:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383199.668066:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383199.668070:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383199.668084:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668090:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383199.668102:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668109:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b6400/0xc40acec91532e28e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668118:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383199.668121:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e256 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668127:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8000 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383199.668129:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e256 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668135:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e256 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383199.668141:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e256 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383199.668154:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383199.668168:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e256 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668174:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383199.668180:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e256 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668186:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c8000/0xc40acec91532e24f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e256 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668194:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383199.668197:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e22c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668203:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655400 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383199.668205:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e22c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668211:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e22c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383199.668218:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e22c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383199.668223:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383199.668234:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e22c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668239:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383199.668250:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e22c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668257:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e22c expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668269:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383199.668271:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383199.668273:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383199.668295:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984799488:0@lo:103: 00000100:00100000:1.0:1787383199.668328:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383199.668359:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984800000:0@lo:103: 00000100:00100000:1.0:1787383199.668382:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383199.668400:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383199.668405:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984799616:0@lo:103: 00000100:00100000:1.0:1787383199.668425:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383199.668451:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984799488 00000100:00100000:1.0:1787383199.668456:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984799488 00010000:00010000:1.0:1787383199.668476:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636352c0000/0xc40acec91532e2db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e2d4 expref: 20 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383199.668496:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984800000 00000100:00100000:1.0:1787383199.668499:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984800000 00010000:00010000:1.0:1787383199.668508:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636102b6200/0xc40acec91532e22c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e225 expref: 21 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383199.668521:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984799616 00000100:00100000:1.0:1787383199.668523:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984799616 00010000:00010000:1.0:1787383199.668532:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963601655c00/0xc40acec91532e2b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e2aa expref: 22 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383199.668572:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787383199.668579:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+22:3649:x1874206984799488:12345-0@lo:103: 00010000:00010000:1.0:1787383199.668589:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383199.668594:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636352c0000/0xc40acec91532e2db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e2d4 expref: 22 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668603:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636352c0000/0xc40acec91532e2db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e2d4 expref: 22 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668618:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383199.668644:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+22:3649:x1874206984799488:12345-0@lo:103: Request processed in 66us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.668649:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787383199.668664:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787383199.668670:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+21:3649:x1874206984800000:12345-0@lo:103: 00010000:00010000:1.0:1787383199.668677:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383199.668681:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636102b6200/0xc40acec91532e22c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e225 expref: 21 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668688:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636102b6200/0xc40acec91532e22c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e225 expref: 21 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668697:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383199.668716:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+21:3649:x1874206984800000:12345-0@lo:103: Request processed in 47us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.668722:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787383199.668755:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787383199.668796:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503172680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+20:3649:x1874206984799616:12345-0@lo:103: 00010000:00010000:1.0:1787383199.668816:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383199.668821:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963601655c00/0xc40acec91532e2b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e2aa expref: 20 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668831:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963601655c00/0xc40acec91532e2b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e2aa expref: 20 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.668840:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383199.668864:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503172680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+20:3649:x1874206984799616:12345-0@lo:103: Request processed in 71us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.668870:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787383199.668908:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984799616:0@lo:103: 00000100:00100000:1.0:1787383199.668917:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984799488:0@lo:103: 00000100:00100000:1.0:1787383199.668924:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984800000:0@lo:103: 00000100:00100000:1.0:1787383199.668947:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984799744:0@lo:103: 00000100:00100000:1.0:1787383199.668970:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383199.668992:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383199.668998:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984799872:0@lo:103: 00000100:00100000:1.0:1787383199.669018:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383199.669037:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984799744 00000100:00100000:1.0:1787383199.669040:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984799744 00010000:00010000:1.0:1787383199.669054:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c9a00/0xc40acec91532e295 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e28e expref: 20 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383199.669071:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984799872 00000100:00100000:1.0:1787383199.669074:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984799872 00010000:00010000:1.0:1787383199.669093:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636352c1200/0xc40acec91532e256 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e24f expref: 21 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383199.669109:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787383199.669115:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+21:3647:x1874206984799744:12345-0@lo:103: 00010000:00010000:1.0:1787383199.669123:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383199.669126:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c9a00/0xc40acec91532e295 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e28e expref: 21 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.669134:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c9a00/0xc40acec91532e295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e28e expref: 21 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.669144:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383199.669170:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+21:3647:x1874206984799744:12345-0@lo:103: Request processed in 55us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.669175:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787383199.669187:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787383199.669193:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503173800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+20:3647:x1874206984799872:12345-0@lo:103: 00010000:00010000:1.0:1787383199.669199:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383199.669203:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636352c1200/0xc40acec91532e256 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e24f expref: 20 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.669212:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636352c1200/0xc40acec91532e256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e24f expref: 20 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.669223:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.669231:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.669255:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.669263:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.669269:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.669275:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.669281:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383199.669285:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.669292:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.669300:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.669309:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383199.669333:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503173800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+20:3647:x1874206984799872:12345-0@lo:103: Request processed in 139us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.669339:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787383199.669358:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383199.669373:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984799872:0@lo:103: 00000100:00100000:1.0:1787383199.669381:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984799744:0@lo:103: 00010000:00010000:0.0:1787383199.669579:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c0000/0xc40acec91532e2db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e2d4 expref: 19 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.669592:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984798592:0@lo:104: 00010000:00010000:0.0:1787383199.669602:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963601655c00/0xc40acec91532e2b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e2aa expref: 18 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.669610:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984798976:0@lo:104: 00010000:00010000:0.0:1787383199.669619:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9a00/0xc40acec91532e295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e28e expref: 17 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.669626:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984799104:0@lo:104: 00010000:00010000:0.0:1787383199.669645:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c1200/0xc40acec91532e256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e24f expref: 16 pid: 6514 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.669654:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984799232:0@lo:104: 00010000:00010000:0.0:1787383199.669662:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b6200/0xc40acec91532e22c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e225 expref: 15 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.669670:0:6514:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6514:1874206984799360:0@lo:104: 00010000:00010000:0.0:1787383199.669696:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.669704:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.669710:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.669715:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9400/0xc40acec91532e336 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787383199.669725:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787383199.676067:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+14:9512:x1874206984798208:12345-0@lo:253: Request processed in 30164us (30434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383199.676081:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787383199.676195:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984798208:0@lo:253: 10000000:01000000:3.0:1787383199.676222:0:9512:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787383199.676226:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787383199.676227:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787383199.676228:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383199.676229:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787383199.676230:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383199.676231:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383199.676233:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383199.676234:0:9512:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787383199.676236:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383199.676237:0:9512:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787383199.676255:0:9512:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96350233b000 from lustre-OST0001 10000000:01000000:3.0:1787383199.676281:0:9512:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787383199.676284:0:9512:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787383199.676292:0:9512:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9636345a8000 local copy 10000000:01000000:3.0:1787383199.676296:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787383199.676329:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383199.676340:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383199.676348:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383199.676365:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984800128:0@lo:101: 00000100:00100000:3.0:1787383199.676397:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383199.676434:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636064c6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383199.676482:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984800128 00000100:00100000:1.0:1787383199.676489:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984800128 00000100:00100000:1.0:1787383199.676562:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787383199.676571:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+14:9512:x1874206984800128:12345-0@lo:101: 00010000:00010000:1.0:1787383199.676583:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383199.676596:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c0600/0xc40acec91532e344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e33d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.676619:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0600/0xc40acec91532e344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e33d expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.676628:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c0600/0xc40acec91532e344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e33d expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383199.676638:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0600, rc 0) 00000100:00100000:1.0:1787383199.676678:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:9512:x1874206984800128:12345-0@lo:101: Request processed in 109us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.676683:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787383199.676742:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984800128:0@lo:101: 00010000:00010000:0.0:1787383199.676754:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc40acec91532e344 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.676763:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc40acec91532e344 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.676896:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984800256:0@lo:501: 00000100:00100000:0.0:1787383199.676920:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383199.679649:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984800256 00000100:00100000:3.0:1787383199.679663:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984800256 00000100:00100000:0.0:1787383199.679688:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146780 going to sleep for 11 seconds 00000100:00100000:3.0:1787383199.679885:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787383199.679897:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:9512:x1874206984800256:12345-0@lo:501: 00000100:00100000:3.0:1787383199.680059:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:9512:x1874206984800256:12345-0@lo:501: Request processed in 164us (3135us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787383199.680068:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787383199.680091:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984800256:0@lo:501: 10000000:01000000:0.0:1787383199.680118:0:9512:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787383199.680143:0:9512:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787383199.680151:0:9512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc40acec91532e344 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.680162:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc40acec91532e344 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.680169:0:9512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc40acec91532e344 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.680185:0:9512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787383199.680231:0:9512:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96350233b000 10000000:01000000:0.0:1787383199.680237:0:9512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787383199.680243:0:9512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787383199.680246:0:9512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383199.680250:0:9512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787383199.680252:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787383199.680279:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.680287:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.680308:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.680327:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984800384:0@lo:101: 00000100:00100000:0.0:1787383199.680361:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383199.680389:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383199.680431:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984800384 00000100:00100000:3.0:1787383199.680436:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984800384 00000100:00100000:3.0:1787383199.680466:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787383199.680483:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:9512:x1874206984800384:12345-0@lo:101: 00010000:00010000:3.0:1787383199.680491:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383199.680503:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963601655c00/0xc40acec91532e352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e34b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383199.680524:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963601655c00/0xc40acec91532e352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e34b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383199.680534:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963601655c00/0xc40acec91532e352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e34b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383199.680542:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655c00, rc 0) 00000100:00100000:3.0:1787383199.680569:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984800384:12345-0@lo:101: Request processed in 96us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383199.680575:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787383199.680889:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984800384:0@lo:101: 00010000:00010000:0.0:1787383199.680903:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e352 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.680912:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e352 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.680980:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984800512:0@lo:501: 00000100:00100000:0.0:1787383199.681006:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383199.681029:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146c00 going to sleep for 11 seconds 00010000:00010000:2.0:1787383199.681088:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383199.681096:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc40acec91532e344 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.681103:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655000 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383199.681115:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc40acec91532e344 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.681123:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc40acec91532e344 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383199.681130:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc40acec91532e344 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383199.681136:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383199.681156:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc40acec91532e344 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.681163:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787383199.681238:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984800512 00000100:00100000:3.0:1787383199.681243:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984800512 00000100:00100000:3.0:1787383199.681267:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787383199.681273:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984800512:12345-0@lo:501: 00010000:00010000:2.0:1787383199.681327:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc40acec91532e344 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.681335:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601655000/0xc40acec91532e33d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc40acec91532e344 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.681347:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383199.681349:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383199.681352:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383199.681387:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984800512:12345-0@lo:501: Request processed in 112us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383199.681396:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787383199.681453:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984800512:0@lo:501: 00000100:00100000:2.0:1787383199.681481:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984800768:0@lo:503: 00000100:00100000:2.0:1787383199.681522:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.681548:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635026aecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383199.681596:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984800768 00000100:00100000:0.0:1787383199.681601:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984800768 00000100:00100000:0.0:1787383199.681637:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787383199.681645:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984800768:12345-0@lo:503: 00000100:00100000:0.0:1787383199.681725:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984800768:12345-0@lo:503: Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383199.681732:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787383199.681855:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984800768:0@lo:503: 00000040:00080000:2.0:1787383199.682106:0:9512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787383199.682113:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984800640:0@lo:103: 00000100:00100000:1.0:1787383199.682154:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.682185:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984800896:0@lo:502: 00000100:00100000:2.0:1787383199.682220:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.682237:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635026aecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383199.682375:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984800640 00000100:00100000:0.0:1787383199.682380:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984800640 00000100:00100000:0.0:1787383199.682419:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383199.682426:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503171880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+16:3650:x1874206984800640:12345-0@lo:103: 00010000:00010000:0.0:1787383199.682441:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383199.682459:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c0600/0xc40acec91532e344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e33d expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383199.682464:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984800896 00000100:00100000:1.0:1787383199.682470:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984800896 00010000:00010000:0.0:1787383199.682473:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383199.682507:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503171880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+16:3650:x1874206984800640:12345-0@lo:103: Request processed in 82us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383199.682513:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383199.682539:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984800640:0@lo:103: 00000100:00100000:1.0:1787383199.682876:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787383199.682887:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:9512:x1874206984800896:12345-0@lo:502: 00000100:00100000:1.0:1787383199.682985:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:9512:x1874206984800896:12345-0@lo:502: Request processed in 100us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.682992:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787383199.683239:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984800896:0@lo:502: 00000040:00080000:2.0:1787383199.683448:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787383199.683479:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787383199.683494:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787383199.683505:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787383199.683517:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787383199.683528:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787383199.683554:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801024:0@lo:502: 00000100:00100000:2.0:1787383199.683596:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.683671:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635026aecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383199.688856:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984801024 00000100:00100000:3.0:1787383199.688872:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984801024 00000100:00100000:3.0:1787383199.688940:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787383199.688949:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:9512:x1874206984801024:12345-0@lo:502: 00000100:00100000:3.0:1787383199.689534:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:9512:x1874206984801024:12345-0@lo:502: Request processed in 583us (5935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383199.689544:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787383199.689712:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801024:0@lo:502: 00000040:00080000:0.0:1787383199.689926:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787383199.689942:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1787383199.693389:0:9523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787383199.693401:0:9523:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1787383199.693409:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383199.693411:0:9523:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787383199.693417:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383199.693433:0:9523:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff963627a399c0) 00000020:00000080:2.0:1787383199.693457:0:9523:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787383199.693464:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787383199.693543:0:9523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96350233b000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787383199.693552:0:9523:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787383199.693559:0:9523:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc40acec91532e360 00010000:00010000:3.0:1787383199.698601:0:9523:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1787383199.698944:0:9523:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787383199.703899:0:9523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787383199.704492:0:9523:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787383199.709141:0:9523:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787383199.709337:0:9523:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787383199.716498:0:9523:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787383199.718697:0:9523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787383199.718711:0:9523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383199.718718:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383199.718721:0:9523:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787383199.718727:0:9523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383199.718730:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383199.718731:0:9523:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787383199.718734:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787383199.718735:0:9523:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787383199.718886:0:9523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383199.718890:0:9523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383199.718891:0:9523:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787383199.718895:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787383199.719145:0:9512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787383199.719181:0:9512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787383199.719195:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e352 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.719208:0:9512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e352 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383199.719216:0:9512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96350233b000 from 1 10000000:01000000:0.0:1787383199.719219:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383199.719252:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.719259:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.719269:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.719299:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801152:0@lo:101: 00000100:00100000:0.0:1787383199.719363:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383199.719421:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a0e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383199.719599:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984801152 00000100:00100000:3.0:1787383199.719606:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984801152 00000100:00100000:3.0:1787383199.719658:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787383199.719668:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:9512:x1874206984801152:12345-0@lo:101: 00010000:00010000:3.0:1787383199.719687:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383199.719699:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963601655400/0xc40acec91532e36e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e367 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383199.719721:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963601655400/0xc40acec91532e36e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e367 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383199.719732:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963601655400/0xc40acec91532e36e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e367 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383199.719740:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655400, rc 0) 00000100:00100000:3.0:1787383199.719916:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984801152:12345-0@lo:101: Request processed in 136us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383199.719925:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787383199.720209:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801152:0@lo:101: 00010000:00010000:0.0:1787383199.720224:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e36e expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.720234:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e36e expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383199.720315:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801280:0@lo:501: 00000100:00100000:0.0:1787383199.720344:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383199.720375:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a0e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383199.720482:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984801280 00000100:00100000:3.0:1787383199.720487:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984801280 00000100:00100000:3.0:1787383199.720517:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787383199.720525:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984801280:12345-0@lo:501: 00000100:00100000:3.0:1787383199.720616:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984801280:12345-0@lo:501: Request processed in 91us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383199.720622:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787383199.720687:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801280:0@lo:501: 00000100:00100000:0.0:1787383199.720711:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801408:0@lo:503: 00000100:00100000:0.0:1787383199.720785:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383199.720800:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a0e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383199.720954:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984801408 00000100:00100000:3.0:1787383199.720959:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984801408 00000100:00100000:3.0:1787383199.721213:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787383199.721221:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984801408:12345-0@lo:503: 00000100:00100000:3.0:1787383199.721299:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984801408:12345-0@lo:503: Request processed in 79us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383199.721306:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787383199.721461:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801408:0@lo:503: 00000040:00080000:0.0:1787383199.721693:0:9512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383199.722120:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801536:0@lo:502: 00000100:00100000:0.0:1787383199.722167:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383199.722231:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383199.728130:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984801536 00000100:00100000:3.0:1787383199.728145:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984801536 00000100:00100000:3.0:1787383199.728240:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787383199.728251:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984801536:12345-0@lo:502: 00000100:00100000:3.0:1787383199.728425:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984801536:12345-0@lo:502: Request processed in 176us (6256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383199.728433:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787383199.728536:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801536:0@lo:502: 00000040:00080000:2.0:1787383199.728798:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787383199.728840:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787383199.728874:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801664:0@lo:502: 00000100:00100000:2.0:1787383199.728920:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.729506:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635026ae900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383199.729599:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984801664 00000100:00100000:1.0:1787383199.729613:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984801664 00000100:00100000:1.0:1787383199.729647:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787383199.729656:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984801664:12345-0@lo:502: 00000100:00100000:1.0:1787383199.729855:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984801664:12345-0@lo:502: Request processed in 200us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.729863:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787383199.730134:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801664:0@lo:502: 00000040:00080000:2.0:1787383199.730191:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787383199.730204:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787383199.730484:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383199.730493:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383199.730495:0:9527:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787383199.730502:0:9527:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96350233b000 00000020:00000080:2.0:1787383199.730505:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787383199.730518:0:9527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383199.730520:0:9527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383199.730522:0:9527:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787383199.730525:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787383199.730556:0:9512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787383199.730584:0:9512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383199.730600:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e36e expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.730611:0:9512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e36e expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383199.730655:0:9512:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787383199.730659:0:9512:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96350233b000 10000000:01000000:2.0:1787383199.730662:0:9512:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96350233b000 10000000:01000000:2.0:1787383199.730666:0:9512:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787383199.730671:0:9512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96350233b000 from 1 10000000:01000000:2.0:1787383199.730674:0:9512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787383199.730700:0:9512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.730708:0:9512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.730724:0:9512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383199.730755:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801792:0@lo:101: 00000100:00100000:2.0:1787383199.730827:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.730861:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635026ae000 going to sleep for 11 seconds 00000100:00100000:3.0:1787383199.730960:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984801792 00000100:00100000:3.0:1787383199.730967:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984801792 00000100:00100000:3.0:1787383199.730998:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787383199.731006:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:9512:x1874206984801792:12345-0@lo:101: 00010000:00010000:3.0:1787383199.731015:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383199.731028:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963601654000/0xc40acec91532e37c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e375 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383199.731049:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963601654000/0xc40acec91532e37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e375 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383199.731059:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963601654000/0xc40acec91532e37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e375 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383199.731067:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601654000, rc 0) 00000100:00100000:3.0:1787383199.731109:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:9512:x1874206984801792:12345-0@lo:101: Request processed in 104us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383199.731115:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787383199.731228:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801792:0@lo:101: 00010000:00010000:2.0:1787383199.731240:0:9512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e37c expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.731249:0:9512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e37c expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383199.731317:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801920:0@lo:501: 00000100:00100000:2.0:1787383199.731345:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.731375:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635026ae000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383199.731496:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984801920 00000100:00100000:1.0:1787383199.731501:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984801920 00000100:00100000:1.0:1787383199.731521:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787383199.731527:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:9512:x1874206984801920:12345-0@lo:501: 00000100:00100000:1.0:1787383199.731623:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:9512:x1874206984801920:12345-0@lo:501: Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.731630:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787383199.731878:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984801920:0@lo:501: 00000100:00100000:2.0:1787383199.731906:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984802048:0@lo:503: 00000100:00100000:2.0:1787383199.731947:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.731965:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635026ae000 going to sleep for 11 seconds 00000100:00100000:2.0:1787383199.732107:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984802048 00000100:00100000:2.0:1787383199.732112:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984802048 00000100:00100000:2.0:1787383199.732132:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787383199.732137:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:9512:x1874206984802048:12345-0@lo:503: 00000100:00100000:2.0:1787383199.732215:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:9512:x1874206984802048:12345-0@lo:503: Request processed in 77us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383199.732228:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787383199.732271:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984802048:0@lo:503: 00000040:00080000:2.0:1787383199.734199:0:9512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787383199.734286:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984802176:0@lo:502: 00000100:00100000:2.0:1787383199.734357:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383199.734488:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984802176 00000100:00100000:0.0:1787383199.734495:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984802176 00000100:00100000:0.0:1787383199.734542:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787383199.734558:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:9512:x1874206984802176:12345-0@lo:502: 00000100:00100000:0.0:1787383199.734661:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:9512:x1874206984802176:12345-0@lo:502: Request processed in 104us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383199.734668:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787383199.735490:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635026ae000 going to sleep for 11 seconds 00000100:00100000:2.0:1787383199.735518:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984802176:0@lo:502: 00000040:00080000:2.0:1787383199.735738:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787383199.736557:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787383199.736577:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787383199.736607:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787383199.736624:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787383199.736638:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787383199.736649:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787383199.736662:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787383199.736675:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787383199.736688:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787383199.736701:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787383199.736715:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787383199.736727:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787383199.736742:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787383199.738030:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787383199.738044:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787383199.738054:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787383199.738065:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787383199.738076:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787383199.738103:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787383199.738115:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787383199.738125:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787383199.738145:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787383199.738158:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787383199.738174:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787383199.738187:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787383199.738199:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787383199.738211:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1787383199.738224:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787383199.738237:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1787383199.738249:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1787383199.738261:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1787383199.738275:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1787383199.738288:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1787383199.738301:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1787383199.738328:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1787383199.738343:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1787383199.738357:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1787383199.738369:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1787383199.738380:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1787383199.738410:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1787383199.738422:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1787383199.738432:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1787383199.738444:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1787383199.738457:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1787383199.738469:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1787383199.738514:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984802304:0@lo:502: 00000100:00100000:2.0:1787383199.738590:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.738635:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635026ae900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383199.738973:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984802304 00000100:00100000:1.0:1787383199.738981:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984802304 00000100:00100000:1.0:1787383199.739043:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787383199.739053:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:9512:x1874206984802304:12345-0@lo:502: 00000100:00100000:1.0:1787383199.739167:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:9512:x1874206984802304:12345-0@lo:502: Request processed in 115us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.739175:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787383199.739953:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984802304:0@lo:502: 00000040:00080000:2.0:1787383199.740036:0:9512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1787383199.740048:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1787383199.740618:0:9528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787383199.740634:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9636351b0000) 00000020:00000080:0.0:1787383199.740657:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1787383199.740874:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96350233b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787383199.740878:0:9528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96350233b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787383199.740881:0:9528:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96350233b000 3 00010000:00080000:0.0:1787383199.740909:0:9528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963502314800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1787383199.745222:0:9528:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1787383199.745328:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787383199.745387:0:9528:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787383199.745408:0:9528:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc40acec91532e38a 00000100:00080000:0.0:1787383199.745419:0:9528:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383199.745424:0:9528:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff963502314800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383199.745458:0:9528:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363f994e00 x1874206984802432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787383199.746316:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984802432:0@lo:38: 00000100:00100000:3.0:1787383199.746402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383199.746486:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984802432 00000100:00100000:1.0:1787383199.746495:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984802432 00000100:00100000:1.0:1787383199.746540:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383199.746549:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984802432:12345-0@lo:38: 00010000:00080000:1.0:1787383199.746575:0:6520:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1787383199.746620:0:6520:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc40acec91532e391 00000004:00100000:1.0:1787383199.746636:0:6520:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787383199.746677:0:6520:0:(import.c:65:import_set_state_nolock()) ffff963503117800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787383199.746779:0:9528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787383199.747119:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874206984802432:12345-0@lo:38: Request processed in 568us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383199.747127:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:1.0:1787383199.747464:0:9528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787383199.747480:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9636352ccd40) 00000020:00000080:1.0:1787383199.747504:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00080000:0.0:1787383199.748974:0:9530:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff96363f994a80 x1874206984802560/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383199.748989:0:9530:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605301900 going to sleep for 0 seconds 00000020:01000004:0.0:1787383199.750028:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96350233b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787383199.750036:0:9528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96350233b000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787383199.750040:0:9528:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96350233b000 3 00010000:00080000:0.0:1787383199.750078:0:9528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9635034f1000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.102@tcp at head 00010000:00080000:3.0:1787383199.754599:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363f994e00 x1874206984802432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383199.754621:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787383199.754631:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787383199.754642:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787383199.754647:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787383199.754650:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963502314800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787383199.754658:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005269f7f7): req@ffff96363f994a80 x1874206984802560/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383199.754681:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984802432:0@lo:38: 00000100:00100000:3.0:1787383199.755181:0:9530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383199.755213:0:9530:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605301900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383199.756645:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984802560 00000100:00100000:0.0:1787383199.756665:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984802560 00000100:00100000:0.0:1787383199.756737:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787383199.757149:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383199.757508:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1874206984802560:12345-0@lo:901: 00000100:00100000:0.0:1787383199.758898:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1874206984802560:12345-0@lo:901: Request processed in 2147us (3711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383199.758910:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787383199.759597:0:9528:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1787383199.759703:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787383199.762521:0:9528:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787383199.762546:0:9528:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc40acec91532e39f 00000100:00080000:2.0:1787383199.762558:0:9528:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383199.762564:0:9528:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9635034f1000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383199.762604:0:9528:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963502068a80 x1874206984802688/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383199.762639:0:9528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787383199.762899:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1874206984802688:0@lo:38: 00000100:00100000:0.0:1787383199.762987:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.764495:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984802688 00000100:00100000:2.0:1787383199.764511:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984802688 00000100:00100000:2.0:1787383199.764563:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787383199.764572:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1874206984802688:12345-0@lo:38: 00010000:00080000:2.0:1787383199.764603:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:2.0:1787383199.764654:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc40acec91532e3a6 00000004:00100000:2.0:1787383199.764671:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787383199.764703:0:6522:0:(import.c:65:import_set_state_nolock()) ffff963503160800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383199.764825:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874206984802688:12345-0@lo:38: Request processed in 253us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383199.764833:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787383199.764887:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963502068a80 x1874206984802688/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383199.764898:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787383199.764905:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787383199.764913:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787383199.764917:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787383199.764920:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9635034f1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787383199.764926:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1874206984802688:0@lo:38: 00000040:00080000:2.0:1787383199.765054:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1787383199.765121:0:9512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1787383199.765151:0:9512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787383199.765166:0:9512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e37c expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.765176:0:9512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e37c expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787383199.765214:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787383199.765216:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787383199.765218:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383199.765219:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383199.765220:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383199.765221:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383199.765223:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787383199.765224:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787383199.765225:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787383199.765227:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383199.765228:0:9512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787383199.765231:0:9512:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787383199.765234:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787383199.765235:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787383199.765237:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383199.765238:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383199.765238:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383199.765240:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383199.765241:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787383199.765242:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787383199.765243:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787383199.765244:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383199.765245:0:9512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787383199.765261:0:9512:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787383199.765273:0:9512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984802816:0@lo:253: 00000100:00100000:2.0:1787383199.765310:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.765335:0:9512:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635026aecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383199.765356:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984802816 00000100:00100000:2.0:1787383199.765364:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984802816 00000100:00100000:2.0:1787383199.765413:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787383199.765419:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:9512:x1874206984802816:12345-0@lo:253: 20000000:01000000:2.0:1787383199.765439:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787383199.765452:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1787383199.766003:0:9530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363f994a80 x1874206984802560/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787383215 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383199.766017:0:9530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1874206984802560:0@lo:901: 20000000:01000000:2.0:1787383199.772579:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787383199.772637:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787383199.773225:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:9512:x1874206984802816:12345-0@lo:253: Request processed in 7801us (7909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383199.773238:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787383199.773376:0:9512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:68140aec-1198-480f-b348-a4187c7bb1d1:9512:1874206984802816:0@lo:253: 10000000:01000000:1.0:1787383199.773400:0:9512:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787383199.773404:0:9512:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787383199.773406:0:9512:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787383199.773407:0:9512:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383199.773409:0:9512:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383199.773410:0:9512:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383199.773411:0:9512:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383199.773413:0:9512:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383199.773414:0:9512:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787383199.773416:0:9512:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787383199.773417:0:9512:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383199.773418:0:9512:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787383199.773434:0:9512:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787383199.778507:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787383199.778516:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787383199.781508:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.781533:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963601654e00/0xc40acec91532e2a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e29c expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.781541:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636352c0400/0xc40acec91532e2e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e2e2 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.781549:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.781588:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636352c0400/0xc40acec91532e2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e2e2 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.781602:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636352c0400/0xc40acec91532e2e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e2e2 expref: 16 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383199.781615:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984802944:0@lo:104: 00000100:00100000:2.0:1787383199.781672:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:1.0:1787383199.782337:0:9512:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00010000:00010000:2.0:1787383199.782783:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963601654e00/0xc40acec91532e2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e29c expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.782818:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff963601654e00/0xc40acec91532e2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e29c expref: 16 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383199.782831:0:6536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984803072:0@lo:104: 00000100:00100000:2.0:1787383199.782868:0:6536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:1.0:1787383199.783069:0:9512:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787383199.783269:0:9512:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787383199.783420:0:9512:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787383199.783612:0:9512:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787383199.783867:0:9512:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:2.0:1787383199.784618:0:6536:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635026ae840 going to sleep for 11 seconds 00000100:00100000:0.0:1787383199.784863:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984802944 00000100:00100000:0.0:1787383199.784872:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984802944 00000100:00100000:0.0:1787383199.784911:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984803072 00000100:00100000:0.0:1787383199.784915:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984803072 00000100:00100000:0.0:1787383199.784932:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787383199.784941:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+4:6536:x1874206984802944:12345-0@lo:104: 00010000:00010000:0.0:1787383199.784958:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e2e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.785046:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787383199.785053:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+4:6536:x1874206984802944:12345-0@lo:104: Request processed in 113us (3380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383199.785060:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787383199.785077:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787383199.785084:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+3:6536:x1874206984803072:12345-0@lo:104: 00010000:00010000:0.0:1787383199.785091:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.785141:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787383199.785147:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+3:6536:x1874206984803072:12345-0@lo:104: Request processed in 64us (2279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383199.785154:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787383199.785257:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984802944:0@lo:104: 00000100:00100000:3.0:1787383199.785268:0:6536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1874206984803072:0@lo:104: 00010000:00010000:3.0:1787383199.785291:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.785616:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383199.785623:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e2e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.785631:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9000 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383199.785635:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e2e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.785643:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e2e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383199.785650:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e2e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383199.785656:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383199.785688:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.785694:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383199.785720:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.785727:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c9000/0xc40acec91532e2e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2e9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.785755:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383199.785759:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.785791:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383199.785794:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.785800:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383199.785817:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383199.785822:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383199.785837:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.785843:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383199.785848:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.785855:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e29c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e2a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.785868:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383199.785869:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383199.785871:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383199.785884:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984803328:0@lo:103: 00000100:00100000:2.0:1787383199.785930:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.785968:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383199.785975:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984803200:0@lo:103: 00000100:00100000:2.0:1787383199.785995:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383199.786037:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984803328 00000100:00100000:2.0:1787383199.786042:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984803328 00010000:00010000:2.0:1787383199.786062:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963601654e00/0xc40acec91532e2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e29c expref: 17 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383199.786086:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984803200 00000100:00100000:2.0:1787383199.786089:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984803200 00010000:00010000:2.0:1787383199.786100:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636352c0400/0xc40acec91532e2e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e2e2 expref: 18 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383199.786118:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787383199.786125:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+18:3648:x1874206984803328:12345-0@lo:103: 00010000:00010000:2.0:1787383199.786135:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383199.786140:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963601654e00/0xc40acec91532e2a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e29c expref: 18 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786149:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963601654e00/0xc40acec91532e2a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e29c expref: 18 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786162:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963601654e00/0xc40acec91532e2a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e29c expref: 18 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786175:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383199.786199:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+17:3648:x1874206984803328:12345-0@lo:103: Request processed in 75us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383199.786205:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787383199.786223:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787383199.786228:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+16:3648:x1874206984803200:12345-0@lo:103: 00010000:00010000:2.0:1787383199.786234:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383199.786238:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636352c0400/0xc40acec91532e2e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e2e2 expref: 16 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786247:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636352c0400/0xc40acec91532e2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e2e2 expref: 16 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786256:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c0400/0xc40acec91532e2e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e2e2 expref: 16 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786267:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786274:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787383199.786286:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008434574s 00010000:00010000:2.0:1787383199.786290:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786297:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786303:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786310:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786315:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b6e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383199.786323:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786330:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786343:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786350:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383199.786369:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+15:3648:x1874206984803200:12345-0@lo:103: Request processed in 141us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383199.786375:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787383199.786674:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984803200:0@lo:103: 00000100:00100000:2.0:1787383199.786682:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984803328:0@lo:103: 00010000:00010000:2.0:1787383199.786701:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786708:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383199.786714:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b6e00/0xc40acec91532e3ad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383199.786844:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787383199.787513:0:9512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787383199.798046:0:9512:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787383199.798056:0:9512:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787383199.798110:0:9512:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787383199.798154:0:9512:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787383199.798183:0:9512:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787383199.798202:0:9512:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787383199.802365:0:9512:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787383199.802607:0:9512:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787383200.416423:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787383200.807926:0:9585:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383200.808235:0:9585:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787383201.435122:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383201.948246:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383201.948269:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984803456:0@lo:41: 00000100:00100000:2.0:1787383201.948334:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383201.948381:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984803456 00000100:00100000:0.0:1787383201.948391:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984803456 00000100:00100000:0.0:1787383201.948449:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787383201.948553:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984803456:12345-0@lo:41: 00000004:00000024:0.0:1787383201.948591:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787383201.948651:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984803456:12345-0@lo:41: Request processed in 191us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383201.948658:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787383201.948811:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984803456:0@lo:41: 00010000:00010000:2.0:1787383202.461502:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383203.482932:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383203.995112:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383203.995150:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984803584:0@lo:41: 00000100:00100000:1.0:1787383203.995246:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383203.995463:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984803584 00000100:00100000:0.0:1787383203.995473:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984803584 00000100:00100000:0.0:1787383203.995540:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787383203.995561:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984803584:12345-0@lo:41: 00000004:00000024:0.0:1787383203.995611:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1787383203.995674:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984803584:12345-0@lo:41: Request processed in 123us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383203.995681:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787383203.995744:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984803584:0@lo:41: 00000100:00100000:3.0:1787383204.515335:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984803840:0@lo:13: 00000100:00100000:3.0:1787383204.515438:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383204.515505:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383204.515511:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984803712:0@lo:13: 00000100:00100000:3.0:1787383204.515531:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383204.515565:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984803840 00000100:00100000:3.0:1787383204.515575:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984803840 00000100:00100000:3.0:1787383204.515623:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984803712 00000100:00100000:3.0:1787383204.515625:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984803712 00000100:00100000:3.0:1787383204.515641:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383204.515649:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984803840:12345-0@lo:13: 00002000:00000024:3.0:1787383204.515683:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383204.515725:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984803840:12345-0@lo:13: Request processed in 76us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383204.515733:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383204.515750:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383204.515755:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984803712:12345-0@lo:13: 00002000:00000024:3.0:1787383204.515815:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383204.515837:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984803712:12345-0@lo:13: Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383204.515842:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787383204.515860:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787383204.515889:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362da0ad80 x1874206984803712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383204.515906:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984803712:0@lo:13: 00010000:00080000:3.0:1787383204.515925:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d1880 x1874206984803840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383204.515935:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984803840:0@lo:13: 00010000:00010000:3.0:1787383204.521749:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383205.024904:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984803968:0@lo:400: 00000100:00100000:3.0:1787383205.025011:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.025073:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984804480:0@lo:400: 00000100:00100000:3.0:1787383205.025104:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.025125:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984804992:0@lo:400: 00000100:00100000:3.0:1787383205.025154:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.025188:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787383205.025194:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984804096:0@lo:400: 00000100:00100000:3.0:1787383205.025218:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.025235:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984804608:0@lo:400: 00000100:00100000:3.0:1787383205.025253:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.025268:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984805120:0@lo:400: 00000100:00100000:3.0:1787383205.025289:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.025322:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984804224:0@lo:400: 00000100:00100000:3.0:1787383205.025346:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.025364:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984804736:0@lo:400: 00000100:00100000:3.0:1787383205.025421:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.025443:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984805248:0@lo:400: 00000100:00100000:3.0:1787383205.025473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.025484:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787383205.025497:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984804352:0@lo:400: 00000100:00100000:3.0:1787383205.025518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.025528:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984804864:0@lo:400: 00000100:00100000:3.0:1787383205.025568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383205.025606:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984803968 00000100:00100000:3.0:1787383205.025616:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984803968 00000100:00100000:3.0:1787383205.025669:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787383205.025678:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:3649:x1874206984803968:12345-0@lo:400: 00000100:00100000:3.0:1787383205.025739:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+15:3649:x1874206984803968:12345-0@lo:400: Request processed in 60us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383205.025746:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787383205.025843:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984804480 00000100:00100000:3.0:1787383205.025848:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984804480 00000100:00100000:3.0:1787383205.025870:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984804224 00000100:00100000:3.0:1787383205.025873:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984804224 00000100:00100000:3.0:1787383205.025889:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787383205.025896:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984804480:12345-0@lo:400: 00000100:00100000:3.0:1787383205.025932:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984804480:12345-0@lo:400: Request processed in 36us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383205.025938:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787383205.025952:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787383205.025957:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984804224:12345-0@lo:400: 00000100:00100000:3.0:1787383205.025990:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984804224:12345-0@lo:400: Request processed in 32us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383205.025996:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787383205.026017:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984804992 00000100:00100000:3.0:1787383205.026020:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984804992 00000100:00100000:3.0:1787383205.026058:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984804864 00000100:00100000:3.0:1787383205.026062:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984804864 00000100:00100000:3.0:1787383205.026082:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383205.026087:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984804992:12345-0@lo:400: 00000100:00100000:3.0:1787383205.026119:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984804992:12345-0@lo:400: Request processed in 31us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383205.026125:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383205.026135:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383205.026140:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984804864:12345-0@lo:400: 00000100:00100000:3.0:1787383205.026164:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984804864:12345-0@lo:400: Request processed in 24us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383205.026170:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383205.026189:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984804096 00000100:00100000:3.0:1787383205.026192:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984804096 00000100:00100000:3.0:1787383205.026211:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984804608 00000100:00100000:3.0:1787383205.026213:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984804608 00000100:00100000:3.0:1787383205.026233:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984805120 00000100:00100000:3.0:1787383205.026235:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984805120 00000100:00100000:3.0:1787383205.026249:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984804736 00000100:00100000:3.0:1787383205.026252:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984804736 00000100:00100000:3.0:1787383205.026267:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984805248 00000100:00100000:3.0:1787383205.026270:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984805248 00000100:00100000:3.0:1787383205.026284:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984804352 00000100:00100000:3.0:1787383205.026287:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984804352 00000100:00100000:3.0:1787383205.026300:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383205.026306:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984804096:12345-0@lo:400: 00000100:00100000:3.0:1787383205.026334:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984804096:12345-0@lo:400: Request processed in 28us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383205.026340:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383205.026352:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787383205.026365:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984804608:12345-0@lo:400: 00000100:00100000:3.0:1787383205.026397:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984804608:12345-0@lo:400: Request processed in 33us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383205.026402:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787383205.026413:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383205.026419:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984805120:12345-0@lo:400: 00000100:00100000:3.0:1787383205.026446:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984805120:12345-0@lo:400: Request processed in 26us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383205.026452:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383205.026463:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787383205.026468:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984804736:12345-0@lo:400: 00000100:00100000:3.0:1787383205.026494:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984804736:12345-0@lo:400: Request processed in 25us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383205.026500:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787383205.026511:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383205.026516:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984805248:12345-0@lo:400: 00000100:00100000:3.0:1787383205.026544:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984805248:12345-0@lo:400: Request processed in 28us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383205.026550:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383205.026561:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787383205.026567:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984804352:12345-0@lo:400: 00000100:00100000:3.0:1787383205.026593:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984804352:12345-0@lo:400: Request processed in 27us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383205.026599:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787383205.026649:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787383205.026654:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787383205.026698:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d0a80 x1874206984804352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383205.026715:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984804352:0@lo:400: 00010000:00080000:3.0:1787383205.026727:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d3480 x1874206984804864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383205.026736:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984804864:0@lo:400: 00000100:00100000:3.0:1787383205.026746:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984804224:0@lo:400: 00010000:00080000:3.0:1787383205.026755:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d1f80 x1874206984804736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383205.026809:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984804736:0@lo:400: 00010000:00080000:3.0:1787383205.026821:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d0000 x1874206984805248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383205.026828:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984805248:0@lo:400: 00010000:00080000:3.0:1787383205.026874:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d3100 x1874206984804096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383205.026883:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984804096:0@lo:400: 00010000:00080000:3.0:1787383205.026895:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d1c00 x1874206984804608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383205.026902:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984804608:0@lo:400: 00010000:00080000:3.0:1787383205.026911:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d1500 x1874206984805120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383205.026918:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984805120:0@lo:400: 00000100:00100000:3.0:1787383205.026940:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984803968:0@lo:400: 00000100:00100000:3.0:1787383205.026951:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984804480:0@lo:400: 00010000:00080000:3.0:1787383205.026962:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d3b80 x1874206984804992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383205.026969:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984804992:0@lo:400: 00010000:00010000:3.0:1787383205.540224:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787383206.462536:0:9874:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787383206.555027:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383207.067183:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984805376:0@lo:41: 00000100:00100000:1.0:1787383207.067279:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383207.067383:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984805376 00000100:00100000:1.0:1787383207.067393:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984805376 00000100:00100000:1.0:1787383207.067452:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787383207.067565:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984805376:12345-0@lo:41: 00000004:00000024:1.0:1787383207.067621:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787383207.067673:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984805376:12345-0@lo:41: Request processed in 212us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383207.067681:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787383207.067751:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984805376:0@lo:41: 00000020:00000004:0.0:1787383207.529749:0:9926:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383207.530933:0:9926:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787383207.589910:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787383208.091402:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787383208.091414:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96363d95c800 from 39 10000000:01000000:3.0:1787383208.091420:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787383208.091481:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383208.091494:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383208.091507:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383208.091539:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984805504:0@lo:101: 00000100:00100000:3.0:1787383208.091635:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.091758:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618141240 going to sleep for 11 seconds 00000100:00100000:2.0:1787383208.093433:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984805504 00000100:00100000:2.0:1787383208.093454:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984805504 00000100:00100000:2.0:1787383208.095422:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787383208.095446:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984805504:12345-0@lo:101: 00010000:00010000:2.0:1787383208.095472:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383208.095499:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b6000/0xc40acec91532e3bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e3b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383208.095536:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b6000/0xc40acec91532e3bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e3b4 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383208.095550:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b6000/0xc40acec91532e3bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e3b4 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383208.095561:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b6000, rc 0) 00000100:00100000:2.0:1787383208.095682:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984805504:12345-0@lo:101: Request processed in 245us (4046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383208.095691:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787383208.095834:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503685880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984805504:0@lo:101: 00010000:00010000:0.0:1787383208.095859:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383208.095869:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e3bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383208.095968:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f996d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984805632:0@lo:501: 00000100:00100000:0.0:1787383208.096013:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383208.100334:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618bd5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.100672:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984805632 00000100:00100000:1.0:1787383208.100685:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984805632 00000100:00100000:0.0:1787383208.100878:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787383208.100891:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984805632:12345-0@lo:501: 00000100:00100000:0.0:1787383208.101112:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984805632:12345-0@lo:501: Request processed in 223us (5097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383208.101120:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787383208.101172:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f996d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984805632:0@lo:501: 00000100:00100000:0.0:1787383208.101235:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f996d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984805760:0@lo:503: 00000100:00100000:0.0:1787383208.101297:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383208.101309:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618bd5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383208.101328:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984805760 00000100:00100000:0.0:1787383208.101332:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984805760 00000100:00100000:0.0:1787383208.101350:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787383208.101356:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984805760:12345-0@lo:503: 00000100:00100000:0.0:1787383208.101449:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984805760:12345-0@lo:503: Request processed in 93us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383208.101457:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787383208.101492:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f996d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984805760:0@lo:503: 00000100:00100000:3.0:1787383208.104455:0:9951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503686a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9951:1874206984805888:0@lo:502: 00000100:00100000:3.0:1787383208.104694:0:9951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383208.104821:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984805888 00000100:00100000:0.0:1787383208.104830:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984805888 00000100:00100000:0.0:1787383208.104888:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787383208.104899:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:9951:x1874206984805888:12345-0@lo:502: 00000100:00100000:0.0:1787383208.105048:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:9951:x1874206984805888:12345-0@lo:502: Request processed in 150us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383208.105059:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787383208.105424:0:9951:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636181413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383208.105453:0:9951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503686a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9951:1874206984805888:0@lo:502: 00000100:00100000:3.0:1787383208.105514:0:9951:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503686a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9951:1874206984806016:0@lo:502: 00000100:00100000:3.0:1787383208.105565:0:9951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.105593:0:9951:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636181413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383208.105809:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984806016 00000100:00100000:0.0:1787383208.105816:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984806016 00000100:00100000:0.0:1787383208.105852:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787383208.105862:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:9951:x1874206984806016:12345-0@lo:502: 00000100:00100000:0.0:1787383208.105973:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:9951:x1874206984806016:12345-0@lo:502: Request processed in 112us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383208.105981:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787383208.106057:0:9951:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503686a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9951:1874206984806016:0@lo:502: 00000040:00080000:3.0:1787383208.106079:0:9951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787383208.106263:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787383208.106286:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787383208.106298:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383208.106311:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383208.106322:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787383208.106325:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787383208.106328:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787383208.106359:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383208.106380:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383208.106392:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383208.106421:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f996d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984806144:0@lo:101: 00000100:00100000:0.0:1787383208.106456:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383208.106481:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618bd5600 going to sleep for 11 seconds 00000100:00100000:3.0:1787383208.106578:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984806144 00000100:00100000:3.0:1787383208.106584:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984806144 00000100:00100000:3.0:1787383208.106620:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787383208.106628:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984806144:12345-0@lo:101: 00010000:00010000:3.0:1787383208.106638:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383208.106654:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963601655600/0xc40acec91532e3c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e3c2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383208.106679:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963601655600/0xc40acec91532e3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e3c2 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383208.106690:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963601655600/0xc40acec91532e3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e3c2 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383208.106700:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655600, rc 0) 00000100:00100000:3.0:1787383208.106733:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984806144:12345-0@lo:101: Request processed in 106us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.106740:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787383208.106802:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f996d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984806144:0@lo:101: 00010000:00010000:3.0:1787383208.106815:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383208.106824:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e3c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383208.106893:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503686a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984806272:0@lo:501: 00000100:00100000:3.0:1787383208.106921:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.106936:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636181413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383208.106949:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984806272 00000100:00100000:3.0:1787383208.106952:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984806272 00000100:00100000:3.0:1787383208.106968:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787383208.106973:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984806272:12345-0@lo:501: 00000100:00100000:3.0:1787383208.107104:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984806272:12345-0@lo:501: Request processed in 129us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.107112:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787383208.107139:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503686a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984806272:0@lo:501: 00000100:00100000:3.0:1787383208.107166:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503686a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984806400:0@lo:503: 00000100:00100000:3.0:1787383208.107204:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.107217:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636181413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383208.107227:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984806400 00000100:00100000:3.0:1787383208.107230:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984806400 00000100:00100000:3.0:1787383208.107247:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787383208.107252:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984806400:12345-0@lo:503: 00000100:00100000:3.0:1787383208.107328:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984806400:12345-0@lo:503: Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.107335:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787383208.107370:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503686a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984806400:0@lo:503: 00000100:00100000:1.0:1787383208.116575:0:9952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9952:1874206984806528:0@lo:502: 00000100:00100000:1.0:1787383208.116689:0:9952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.116744:0:9952:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363530dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383208.116955:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984806528 00000100:00100000:3.0:1787383208.116964:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984806528 00000100:00100000:3.0:1787383208.117033:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787383208.117042:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:9952:x1874206984806528:12345-0@lo:502: 00000100:00100000:3.0:1787383208.117197:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:9952:x1874206984806528:12345-0@lo:502: Request processed in 155us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.117206:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787383208.117396:0:9952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9952:1874206984806528:0@lo:502: 00000020:01000000:1.0:1787383208.117439:0:9952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383208.117451:0:9952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383208.117454:0:9952:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787383208.117463:0:9952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787383208.117465:0:9952:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787383208.117484:0:9952:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9952:1874206984806656:0@lo:502: 00000100:00100000:1.0:1787383208.117516:0:9952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.117539:0:9952:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636187dbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383208.117606:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984806656 00000100:00100000:3.0:1787383208.117611:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984806656 00000100:00100000:3.0:1787383208.117647:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787383208.117655:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:9952:x1874206984806656:12345-0@lo:502: 00000100:00100000:3.0:1787383208.117723:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:9952:x1874206984806656:12345-0@lo:502: Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.117730:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787383208.118003:0:9952:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9952:1874206984806656:0@lo:502: 00000020:01000000:1.0:1787383208.118023:0:9952:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383208.118035:0:9952:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383208.118036:0:9952:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787383208.118041:0:9952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787383208.118214:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787383208.118245:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787383208.118258:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383208.118270:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383208.118281:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787383208.118284:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9636183cf000 from 39 10000000:01000000:3.0:1787383208.118287:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787383208.118320:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383208.118329:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383208.118350:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383208.118366:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503686a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984806784:0@lo:101: 00000100:00100000:3.0:1787383208.118413:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.118440:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618141300 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.118525:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984806784 00000100:00100000:1.0:1787383208.118530:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984806784 00000100:00100000:1.0:1787383208.118568:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787383208.118575:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984806784:12345-0@lo:101: 00010000:00010000:1.0:1787383208.118585:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383208.118599:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c1200/0xc40acec91532e3d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e3d0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.118624:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c1200/0xc40acec91532e3d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e3d0 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.118635:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c1200/0xc40acec91532e3d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e3d0 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.118645:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1200, rc 0) 00000100:00100000:1.0:1787383208.118680:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984806784:12345-0@lo:101: Request processed in 105us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.118686:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787383208.118719:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503686a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984806784:0@lo:101: 00010000:00010000:1.0:1787383208.118731:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.118740:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e3d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383208.118829:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984806912:0@lo:501: 00000100:00100000:1.0:1787383208.118866:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.118879:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636187db240 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.118889:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984806912 00000100:00100000:1.0:1787383208.118893:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984806912 00000100:00100000:1.0:1787383208.118913:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787383208.118918:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984806912:12345-0@lo:501: 00000100:00100000:1.0:1787383208.119049:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984806912:12345-0@lo:501: Request processed in 130us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.119056:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787383208.119084:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984806912:0@lo:501: 00000100:00100000:1.0:1787383208.119113:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984807040:0@lo:503: 00000100:00100000:1.0:1787383208.119151:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.119164:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636187db240 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.119175:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984807040 00000100:00100000:1.0:1787383208.119178:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984807040 00000100:00100000:1.0:1787383208.119196:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787383208.119201:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984807040:12345-0@lo:503: 00000100:00100000:1.0:1787383208.119278:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984807040:12345-0@lo:503: Request processed in 76us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.119285:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787383208.119325:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984807040:0@lo:503: 00000100:00100000:1.0:1787383208.119722:0:9954:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9954:1874206984807168:0@lo:502: 00000100:00100000:1.0:1787383208.119804:0:9954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.119828:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984807168 00000100:00100000:1.0:1787383208.119833:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984807168 00000100:00100000:1.0:1787383208.119854:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787383208.119868:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:9954:x1874206984807168:12345-0@lo:502: 00000100:00100000:1.0:1787383208.119960:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:9954:x1874206984807168:12345-0@lo:502: Request processed in 92us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.119968:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787383208.119999:0:9954:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636187db240 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.120013:0:9954:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9954:1874206984807168:0@lo:502: 00000100:00100000:1.0:1787383208.120056:0:9954:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9954:1874206984807296:0@lo:502: 00000100:00100000:1.0:1787383208.120089:0:9954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.120107:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984807296 00000100:00100000:1.0:1787383208.120111:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984807296 00000100:00100000:1.0:1787383208.120128:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787383208.120134:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:9954:x1874206984807296:12345-0@lo:502: 00000100:00100000:1.0:1787383208.120194:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:9954:x1874206984807296:12345-0@lo:502: Request processed in 60us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.120201:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787383208.120228:0:9954:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.120239:0:9954:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9954:1874206984807296:0@lo:502: 00000040:00080000:1.0:1787383208.120256:0:9954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787383208.120310:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787383208.120331:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787383208.120340:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.120351:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383208.120361:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787383208.120369:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9636183cf000 from 6 10000000:01000000:1.0:1787383208.120372:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787383208.123697:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.123730:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.123834:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383208.123876:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984807424:0@lo:101: 00000100:00100000:1.0:1787383208.123963:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.124014:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.124052:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984807424 00000100:00100000:1.0:1787383208.124059:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984807424 00000100:00100000:1.0:1787383208.124122:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787383208.124132:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984807424:12345-0@lo:101: 00010000:00010000:1.0:1787383208.124149:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383208.124172:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c1600/0xc40acec91532e3e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e3de expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.124199:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c1600/0xc40acec91532e3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e3de expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.124211:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c1600/0xc40acec91532e3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e3de expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.124221:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1600, rc 0) 00000100:00100000:1.0:1787383208.124257:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984807424:12345-0@lo:101: Request processed in 126us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.124279:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787383208.124329:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984807424:0@lo:101: 00010000:00010000:1.0:1787383208.124344:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.124354:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383208.124416:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984807552:0@lo:256: 00000100:00100000:1.0:1787383208.124444:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.124456:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.124466:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984807552 00000100:00100000:1.0:1787383208.124468:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984807552 00000100:00100000:1.0:1787383208.124483:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787383208.124488:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984807552:12345-0@lo:256: 20000000:01000000:1.0:1787383208.124500:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787383208.124519:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787383208.124522:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787383208.124592:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984807552:12345-0@lo:256: Request processed in 102us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.124598:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787383208.124675:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984807552:0@lo:256: 10000000:01000000:1.0:1787383208.124719:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787383208.124727:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.124735:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383208.124759:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787383208.124762:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1787383208.124789:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787383208.124810:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.124817:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.124825:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383208.124835:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984807680:0@lo:101: 00000100:00100000:1.0:1787383208.124857:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.124868:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.124878:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984807680 00000100:00100000:1.0:1787383208.124881:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984807680 00000100:00100000:1.0:1787383208.124895:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787383208.124900:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984807680:12345-0@lo:101: 00010000:00010000:1.0:1787383208.124906:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383208.124914:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c0e00/0xc40acec91532e3f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e3ec expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.124927:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0e00/0xc40acec91532e3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e3ec expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.124936:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c0e00/0xc40acec91532e3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e3ec expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.124953:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0e00, rc 0) 00000100:00100000:1.0:1787383208.124976:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984807680:12345-0@lo:101: Request processed in 76us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.124982:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787383208.125004:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984807680:0@lo:101: 00010000:00010000:1.0:1787383208.125012:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.125020:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e3f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383208.125072:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984807808:0@lo:501: 00000100:00100000:1.0:1787383208.125093:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.125103:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.125112:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984807808 00000100:00100000:1.0:1787383208.125115:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984807808 00000100:00100000:1.0:1787383208.125129:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787383208.125133:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984807808:12345-0@lo:501: 00000100:00100000:1.0:1787383208.125252:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984807808:12345-0@lo:501: Request processed in 117us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.125258:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787383208.125280:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984807808:0@lo:501: 00000100:00100000:1.0:1787383208.125303:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984807936:0@lo:503: 00000100:00100000:1.0:1787383208.125338:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.125348:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.125360:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984807936 00000100:00100000:1.0:1787383208.125363:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984807936 00000100:00100000:1.0:1787383208.125376:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787383208.125381:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96361a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984807936:12345-0@lo:503: 00000100:00100000:1.0:1787383208.127163:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96361a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984807936:12345-0@lo:503: Request processed in 1767us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.127179:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787383208.127376:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984807936:0@lo:503: 00000100:00100000:2.0:1787383208.127978:0:9955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9955:1874206984808064:0@lo:502: 00000100:00100000:2.0:1787383208.128041:0:9955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383208.128079:0:9955:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91480 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.128162:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984808064 00000100:00100000:1.0:1787383208.128170:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984808064 00000100:00100000:1.0:1787383208.128212:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787383208.128221:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:9955:x1874206984808064:12345-0@lo:502: 00000100:00100000:1.0:1787383208.128352:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:9955:x1874206984808064:12345-0@lo:502: Request processed in 131us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.128359:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787383208.128505:0:9955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9955:1874206984808064:0@lo:502: 00000020:01000000:2.0:1787383208.128532:0:9955:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787383208.128543:0:9955:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787383208.128558:0:9955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383208.128561:0:9955:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787383208.128568:0:9955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787383208.128572:0:9955:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:2.0:1787383208.128602:0:9955:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787383208.128606:0:9955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383208.128636:0:9955:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9635033c0000) 00000020:00000080:2.0:1787383208.128668:0:9955:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1787383208.128675:0:9955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787383208.128871:0:9955:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787383208.128879:0:9955:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787383208.128888:0:9955:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532e401 00010000:00080000:2.0:1787383208.128923:0:9955:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9635036f5000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1787383208.129652:0:9955:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1787383208.129860:0:9955:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787383208.129877:0:9955:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787383208.130078:0:9955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383208.130200:0:9955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383208.130393:0:9955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787383208.130588:0:9955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787383208.134590:0:9956:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787383208.134600:0:9956:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787383208.159295:0:9955:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787383208.159317:0:9955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787383208.159380:0:9955:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787383208.159426:0:9955:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532e408 00000100:00080000:0.0:1787383208.159440:0:9955:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383208.159448:0:9955:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9635036f5000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383208.159494:0:9955:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363f995180 x1874206984808192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787383208.159553:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984808192:0@lo:8: 00000100:00100000:3.0:1787383208.159653:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787383208.159986:0:9955:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787383208.160056:0:9955:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383208.160062:0:9955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383208.160064:0:9955:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787383208.160067:0:9955:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383208.160072:0:9955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383208.160073:0:9955:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787383208.160076:0:9955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787383208.160079:0:9955:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787383208.160257:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984808192 00000100:00100000:3.0:1787383208.160267:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984808192 00000100:00100000:3.0:1787383208.160306:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383208.160315:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1874206984808192:12345-0@lo:8: 00010000:00080000:3.0:1787383208.160350:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:3.0:1787383208.160383:0:8435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532e40f 00002000:00100000:3.0:1787383208.160414:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff96363d874800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787383208.160419:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1787383208.160423:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787383208.160504:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787383208.160823:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787383208.160856:0:8435:0:(import.c:65:import_set_state_nolock()) ffff96363d9ce800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383208.160930:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1874206984808192:12345-0@lo:8: Request processed in 614us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.160939:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383208.161088:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984808320:0@lo:400: 00000100:00100000:0.0:1787383208.161209:0:9955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9955:1874206984809600:0@lo:502: 00000100:00100000:0.0:1787383208.161268:0:9955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383208.161305:0:9955:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618bd5000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.162265:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984808576:0@lo:400: 00000100:00100000:1.0:1787383208.162325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.162359:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984809088:0@lo:400: 00000100:00100000:1.0:1787383208.162383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.163526:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787383208.163548:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984808704:0@lo:400: 00000100:00100000:1.0:1787383208.163615:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.163658:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984809216:0@lo:400: 00000100:00100000:3.0:1787383208.163663:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.163699:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984808832:0@lo:400: 00000100:00100000:1.0:1787383208.163703:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.163722:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.163739:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984809344:0@lo:400: 00000100:00100000:1.0:1787383208.163762:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984808576 00000100:00100000:1.0:1787383208.163785:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984808576 00000100:00100000:3.0:1787383208.163786:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.163804:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787383208.163812:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984808448:0@lo:400: 00000100:00100000:1.0:1787383208.163833:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984808320 00000100:00100000:3.0:1787383208.163834:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.163835:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984808320 00000100:00100000:3.0:1787383208.163850:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984808960:0@lo:400: 00000100:00100000:1.0:1787383208.163855:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984808832 00000100:00100000:1.0:1787383208.163858:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984808832 00000100:00100000:3.0:1787383208.163871:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.163881:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984809344 00000100:00100000:3.0:1787383208.163883:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984809472:0@lo:400: 00000100:00100000:1.0:1787383208.163883:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984809344 00000100:00100000:1.0:1787383208.163896:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984808960 00000100:00100000:1.0:1787383208.163899:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984808960 00000100:00100000:3.0:1787383208.163904:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.163911:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984809472 00000100:00100000:1.0:1787383208.163913:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984809472 00000100:00100000:1.0:1787383208.163929:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787383208.163999:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984808704 00000100:00100000:0.0:1787383208.164004:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984808704 00000100:00100000:0.0:1787383208.164029:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984808448 00000100:00100000:0.0:1787383208.164032:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984808448 00000100:00100000:0.0:1787383208.164049:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787383208.164056:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984808704:12345-0@lo:400: 00000100:00100000:0.0:1787383208.164126:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984808704:12345-0@lo:400: Request processed in 69us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383208.164133:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787383208.164155:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787383208.164161:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984808448:12345-0@lo:400: 00000100:00100000:0.0:1787383208.164196:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984808448:12345-0@lo:400: Request processed in 34us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383208.164202:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787383208.164604:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787383208.164616:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984808320:12345-0@lo:400: 00000100:00100000:3.0:1787383208.164652:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984808320:12345-0@lo:400: Request processed in 40us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.164659:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787383208.164676:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787383208.164682:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984808832:12345-0@lo:400: 00000100:00100000:1.0:1787383208.164706:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984808576:12345-0@lo:400: 00000100:00100000:3.0:1787383208.164723:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984808832:12345-0@lo:400: Request processed in 42us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.164729:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787383208.164737:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984808576:12345-0@lo:400: Request processed in 801us (2412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.164741:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787383208.164744:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787383208.164760:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984809344:12345-0@lo:400: 00000100:00100000:1.0:1787383208.164790:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787383208.164796:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984808960:12345-0@lo:400: 00000100:00100000:3.0:1787383208.164803:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984809344:12345-0@lo:400: Request processed in 57us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.164818:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787383208.164819:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984808960:12345-0@lo:400: Request processed in 25us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.164825:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787383208.164831:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787383208.164836:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984809472:12345-0@lo:400: 00000100:00100000:1.0:1787383208.164845:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984809088 00000100:00100000:1.0:1787383208.164849:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984809088 00000100:00100000:3.0:1787383208.164864:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984809472:12345-0@lo:400: Request processed in 29us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.164870:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787383208.164881:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984809216 00000100:00100000:1.0:1787383208.164883:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984809216 00000100:00100000:1.0:1787383208.164905:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383208.164910:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984809088:12345-0@lo:400: 00000100:00100000:1.0:1787383208.164941:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984809088:12345-0@lo:400: Request processed in 31us (2556us total) trans 0 rc 0/0 00010000:00080000:3.0:1787383208.164945:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f995180 x1874206984808192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383208.164947:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383208.164958:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:1.0:1787383208.164958:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787383208.164963:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984809216:12345-0@lo:400: 00000100:00080000:3.0:1787383208.164971:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787383208.164981:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787383208.164988:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787383208.164992:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9635036f5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787383208.164994:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984809216:12345-0@lo:400: Request processed in 31us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.165000:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1787383208.165003:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787383208.165011:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984808192:0@lo:8: 00000100:00080000:1.0:1787383208.165025:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383208.165031:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383208.165033:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383208.165049:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984808448:0@lo:400: 00000100:00100000:1.0:1787383208.165049:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984808704:0@lo:400: 00010000:00080000:3.0:1787383208.165060:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503685f80 x1874206984808960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787383208.165060:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503687b80 x1874206984809216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383208.165070:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984808960:0@lo:400: 00000100:00100000:1.0:1787383208.165070:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984809216:0@lo:400: 00010000:00080000:3.0:1787383208.165080:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503684000 x1874206984809472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787383208.165082:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503684a80 x1874206984808576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383208.165090:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984809472:0@lo:400: 00000100:00100000:1.0:1787383208.165092:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984808576:0@lo:400: 00010000:00080000:1.0:1787383208.165101:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503687480 x1874206984809088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383208.165109:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984809088:0@lo:400: 00000100:00100000:1.0:1787383208.165144:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984809600 00000100:00100000:1.0:1787383208.165148:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984809600 00000100:00100000:1.0:1787383208.165179:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787383208.165187:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:9955:x1874206984809600:12345-0@lo:502: 00000100:00100000:1.0:1787383208.165324:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:9955:x1874206984809600:12345-0@lo:502: Request processed in 138us (4056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.165332:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000004:00080000:2.0:1787383208.165510:0:9956:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787383208.165602:0:9956:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 241193835366ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787383208.165610:0:9956:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787383208.166232:0:9955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9955:1874206984809600:0@lo:502: 00000020:01000000:0.0:1787383208.166280:0:9955:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383208.166291:0:9955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383208.166293:0:9955:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787383208.166299:0:9955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1787383208.166826:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1787383208.166862:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787383208.166876:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383208.166890:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383208.166913:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787383208.166917:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9636064d1800 from 39 10000000:01000000:2.0:1787383208.166920:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787383208.166965:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383208.166973:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383208.166985:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383208.167009:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984809728:0@lo:101: 00000100:00100000:2.0:1787383208.167075:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383208.167123:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383208.167143:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984809728 00000100:00100000:2.0:1787383208.167149:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984809728 00000100:00100000:2.0:1787383208.167201:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787383208.167210:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984809728:12345-0@lo:101: 00010000:00010000:2.0:1787383208.167224:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383208.167238:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b6c00/0xc40acec91532e41d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e416 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383208.167267:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b6c00/0xc40acec91532e41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e416 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383208.167279:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b6c00/0xc40acec91532e41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e416 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383208.167300:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b6c00, rc 0) 00000100:00100000:2.0:1787383208.167339:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984809728:12345-0@lo:101: Request processed in 129us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383208.167347:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787383208.167394:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984809728:0@lo:101: 00010000:00080000:3.0:1787383208.168267:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503687100 x1874206984808320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383208.168300:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984808320:0@lo:400: 00010000:00080000:3.0:1787383208.168317:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503685c00 x1874206984808832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383208.168325:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984808832:0@lo:400: 00010000:00080000:3.0:1787383208.168339:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503685500 x1874206984809344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383208.168347:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984809344:0@lo:400: 00010000:00010000:2.0:1787383208.169312:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e41d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383208.169330:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e41d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383208.169440:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984809856:0@lo:501: 00000100:00100000:2.0:1787383208.169512:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383208.169555:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91840 going to sleep for 11 seconds 00000100:00100000:3.0:1787383208.171479:0:9957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9957:1874206984809984:0@lo:700: 00000100:00100000:3.0:1787383208.171557:0:9957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.171604:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984809984 00000100:00100000:3.0:1787383208.171611:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984809984 00000100:00100000:3.0:1787383208.171680:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787383208.171689:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9957:x1874206984809984:12345-0@lo:700: 00000100:00100000:3.0:1787383208.171731:0:8443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8443:1874206984810112:0@lo:700: 00000100:00100000:3.0:1787383208.171791:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.171816:0:8443:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383208.171828:0:9957:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383208.174934:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984810112 00000100:00100000:2.0:1787383208.174956:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984810112 00000100:00100000:2.0:1787383208.175027:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787383208.175038:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8443:x1874206984810112:12345-0@lo:700: 00000100:00100000:0.0:1787383208.176353:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984809856 00000100:00100000:0.0:1787383208.176369:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984809856 00000100:00100000:0.0:1787383208.176441:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787383208.176450:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984809856:12345-0@lo:501: 00000100:00100000:0.0:1787383208.176653:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984809856:12345-0@lo:501: Request processed in 205us (7141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383208.176662:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787383208.176970:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984809856:0@lo:501: 00000100:00100000:2.0:1787383208.177035:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984810240:0@lo:503: 00000100:00100000:2.0:1787383208.177094:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383208.177162:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91840 going to sleep for 11 seconds 00000100:00080000:1.0:1787383208.177473:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383208.178333:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984810240 00000004:00080000:3.0:1787383208.178343:0:7451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787383208.178354:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984810240 00000100:00100000:0.0:1787383208.178464:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787383208.178474:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984810240:12345-0@lo:503: 00000100:00100000:0.0:1787383208.178651:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984810240:12345-0@lo:503: Request processed in 179us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383208.178661:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787383208.179373:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984810240:0@lo:503: 00000100:00100000:0.0:1787383208.185286:0:9959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9959:1874206984810368:0@lo:502: 00000100:00100000:0.0:1787383208.185396:0:9959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383208.185619:0:9959:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360530f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383208.185625:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984810368 00000100:00100000:3.0:1787383208.185633:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984810368 00000100:00100000:3.0:1787383208.185697:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787383208.185708:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:9959:x1874206984810368:12345-0@lo:502: 00000100:00100000:3.0:1787383208.185905:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:9959:x1874206984810368:12345-0@lo:502: Request processed in 198us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.185914:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 40000000:02000000:3.0:1787383208.186103:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1787383208.186148:0:9959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9959:1874206984810368:0@lo:502: 00000100:00100000:0.0:1787383208.186209:0:9959:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9959:1874206984810496:0@lo:502: 00000100:00100000:0.0:1787383208.186245:0:9959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383208.186276:0:9959:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618bd5000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.186317:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984810496 00000100:00100000:1.0:1787383208.186327:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984810496 00000100:00100000:1.0:1787383208.186358:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787383208.186365:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:9959:x1874206984810496:12345-0@lo:502: 00000100:00100000:1.0:1787383208.186465:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:9959:x1874206984810496:12345-0@lo:502: Request processed in 100us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.186473:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787383208.186645:0:9959:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9959:1874206984810496:0@lo:502: 00000040:00080000:0.0:1787383208.186666:0:9959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787383208.186904:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787383208.186933:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787383208.186945:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e41d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.186958:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e41d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383208.186969:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787383208.186972:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9636064d1800 from 6 10000000:01000000:1.0:1787383208.186976:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787383208.187008:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.187017:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.187027:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383208.187042:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984810624:0@lo:101: 00000100:00100000:1.0:1787383208.187077:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.187100:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383208.187191:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984810624 00000100:00100000:0.0:1787383208.187196:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984810624 00000100:00100000:0.0:1787383208.187231:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787383208.187239:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984810624:12345-0@lo:101: 00010000:00010000:0.0:1787383208.187248:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383208.187264:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c8000/0xc40acec91532e42b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e424 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383208.187290:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c8000/0xc40acec91532e42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e424 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383208.187302:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c8000/0xc40acec91532e42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e424 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383208.187320:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8000, rc 0) 00000100:00100000:0.0:1787383208.187355:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984810624:12345-0@lo:101: Request processed in 116us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383208.187361:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787383208.187524:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984810624:0@lo:101: 00010000:00010000:1.0:1787383208.187546:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.187555:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383208.187614:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984810752:0@lo:256: 00000100:00100000:1.0:1787383208.187649:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.187715:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383208.190129:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984810752 00000100:00100000:0.0:1787383208.190151:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984810752 00000100:00100000:0.0:1787383208.190284:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787383208.190297:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984810752:12345-0@lo:256: 20000000:01000000:0.0:1787383208.190330:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787383208.190351:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787383208.190355:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787383208.190586:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984810752:12345-0@lo:256: Request processed in 290us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383208.190595:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787383208.190689:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984810752:0@lo:256: 10000000:01000000:1.0:1787383208.190794:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787383208.190806:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.190818:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383208.190829:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787383208.190831:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787383208.190834:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787383208.190872:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.190880:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.190889:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383208.190923:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984810880:0@lo:101: 00000100:00100000:1.0:1787383208.190970:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.191011:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.191029:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984810880 00000100:00100000:1.0:1787383208.191034:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984810880 00000100:00100000:1.0:1787383208.191064:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787383208.191071:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984810880:12345-0@lo:101: 00010000:00010000:1.0:1787383208.191082:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383208.191098:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c0800/0xc40acec91532e439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e432 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.191124:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0800/0xc40acec91532e439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e432 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.191137:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c0800/0xc40acec91532e439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e432 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.191148:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0800, rc 0) 00000100:00100000:1.0:1787383208.191178:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984810880:12345-0@lo:101: Request processed in 107us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.191185:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787383208.191220:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984810880:0@lo:101: 00010000:00010000:1.0:1787383208.191233:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e439 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383208.191243:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e439 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383208.191319:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984811008:0@lo:501: 00000100:00100000:1.0:1787383208.191345:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.191359:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.191371:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984811008 00000100:00100000:1.0:1787383208.191374:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984811008 00000100:00100000:1.0:1787383208.191392:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787383208.191397:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984811008:12345-0@lo:501: 00000100:00100000:1.0:1787383208.191539:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984811008:12345-0@lo:501: Request processed in 141us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.191547:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787383208.191576:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984811008:0@lo:501: 00000100:00100000:1.0:1787383208.191605:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984811136:0@lo:503: 00000100:00100000:1.0:1787383208.191648:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383208.191662:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.191673:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984811136 00000100:00100000:1.0:1787383208.191676:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984811136 00000100:00100000:1.0:1787383208.191695:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787383208.191700:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984811136:12345-0@lo:503: 00000100:00100000:1.0:1787383208.191845:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984811136:12345-0@lo:503: Request processed in 143us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.191852:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787383208.191893:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984811136:0@lo:503: 00000100:00100000:0.0:1787383208.194212:0:9960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9960:1874206984811264:0@lo:502: 00000100:00100000:0.0:1787383208.194336:0:9960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383208.194388:0:9960:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a0e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787383208.195088:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984811264 00000100:00100000:1.0:1787383208.195101:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984811264 00000100:00100000:1.0:1787383208.195178:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787383208.195188:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:9960:x1874206984811264:12345-0@lo:502: 00000100:00100000:1.0:1787383208.195373:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:9960:x1874206984811264:12345-0@lo:502: Request processed in 186us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.195382:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787383208.195583:0:9960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9960:1874206984811264:0@lo:502: 00000020:01000000:0.0:1787383208.195623:0:9960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787383208.195632:0:9960:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787383208.195640:0:9960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383208.195643:0:9960:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787383208.195649:0:9960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787383208.195653:0:9960:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:0.0:1787383208.195802:0:9960:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787383208.195806:0:9960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383208.195842:0:9960:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff963503703380) 00000020:00000080:0.0:1787383208.195873:0:9960:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1787383208.195879:0:9960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787383208.195979:0:9960:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787383208.195985:0:9960:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787383208.195994:0:9960:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532e447 00010000:00080000:0.0:1787383208.196031:0:9960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963503162000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1787383208.200726:0:9960:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1787383208.201005:0:9960:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787383208.201026:0:9960:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787383208.201285:0:9960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383208.201448:0:9960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383208.201606:0:9960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787383208.201701:0:9960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787383208.202309:0:9961:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787383208.202315:0:9961:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00010000:00080000:1.0:1787383208.203850:0:8443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d3100 x1874206984810112/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787383224 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383208.203872:0:8443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8443:1874206984810112:0@lo:700: 40000000:02000000:1.0:1787383208.203888:0:8443:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:2.0:1787383208.204069:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8443:x1874206984810112:12345-0@lo:700: Request processed in 29029us (32274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383208.204084:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:00000080:2.0:1787383208.207481:0:9960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787383208.207504:0:9960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787383208.207563:0:9960:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787383208.207599:0:9960:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532e44e 00000100:00080000:2.0:1787383208.207614:0:9960:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383208.207623:0:9960:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff963503162000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383208.207673:0:9960:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963502069500 x1874206984811392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383208.207704:0:9960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787383208.207799:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984811392:0@lo:8: 00000100:00100000:3.0:1787383208.207901:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.207978:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984811392 00000100:00100000:3.0:1787383208.207987:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984811392 00000100:00100000:3.0:1787383208.208033:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383208.208043:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1874206984811392:12345-0@lo:8: 00000020:01000000:2.0:1787383208.208052:0:9960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383208.208058:0:9960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383208.208060:0:9960:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787383208.208063:0:9960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383208.208068:0:9960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383208.208069:0:9960:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787383208.208073:0:9960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787383208.208075:0:9960:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00010000:00080000:3.0:1787383208.208080:0:8434:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000100:00100000:2.0:1787383208.208104:0:9960:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9960:1874206984811520:0@lo:502: 00000020:00000080:3.0:1787383208.208128:0:8434:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532e455 00002000:00100000:3.0:1787383208.208146:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96363d9ca000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787383208.208152:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787383208.208156:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787383208.208172:0:9960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383208.208207:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984811520 00000100:00100000:2.0:1787383208.208212:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984811520 00002000:00080000:3.0:1787383208.208248:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1787383208.208253:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787383208.208261:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+23:9960:x1874206984811520:12345-0@lo:502: 00000100:00080000:3.0:1787383208.208276:0:8434:0:(import.c:65:import_set_state_nolock()) ffff96363d9cb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383208.208330:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874206984811392:12345-0@lo:8: Request processed in 287us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.208339:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787383208.208391:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963502069500 x1874206984811392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383208.208418:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787383208.208428:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787383208.208437:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787383208.208443:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787383208.208453:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963503162000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787383208.208468:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787383208.208474:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+23:9960:x1874206984811520:12345-0@lo:502: Request processed in 211us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.208477:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984811392:0@lo:8: 00000100:00100000:2.0:1787383208.208488:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787383208.208542:0:9960:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91180 going to sleep for 11 seconds 00000100:00100000:2.0:1787383208.208558:0:9960:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:9960:1874206984811520:0@lo:502: 00000020:01000000:2.0:1787383208.208582:0:9960:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383208.208587:0:9960:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383208.208589:0:9960:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787383208.208594:0:9960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1787383208.208663:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1787383208.208688:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787383208.208701:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e439 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383208.208713:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e439 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383208.208726:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787383208.208729:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9636345a8000 from 1 10000000:01000000:2.0:1787383208.208732:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787383208.210704:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383208.210727:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787383208.210920:0:9961:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:2.0:1787383208.211050:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383208.211085:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984811648:0@lo:101: 00000100:00100000:2.0:1787383208.211193:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383208.211255:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91180 going to sleep for 11 seconds 00000100:00100000:0.0:1787383208.211271:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984811648 00000100:00100000:0.0:1787383208.211281:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984811648 00000100:00100000:0.0:1787383208.211337:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787383208.211347:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984811648:12345-0@lo:101: 00010000:00010000:0.0:1787383208.211363:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383208.211378:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c9000/0xc40acec91532e463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e45c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383208.211407:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9000/0xc40acec91532e463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e45c expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383208.211418:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c9000/0xc40acec91532e463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e45c expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383208.211429:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9000, rc 0) 00000100:00100000:0.0:1787383208.211479:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984811648:12345-0@lo:101: Request processed in 132us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383208.211487:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787383208.211517:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984811648:0@lo:101: 00010000:00010000:2.0:1787383208.211536:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e463 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383208.211546:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e463 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383208.211617:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984811776:0@lo:501: 00000100:00100000:2.0:1787383208.211647:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383208.211662:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91180 going to sleep for 11 seconds 00000100:00100000:2.0:1787383208.211677:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984811776 00000100:00100000:2.0:1787383208.211681:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984811776 00000100:00100000:2.0:1787383208.211709:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787383208.211716:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984811776:12345-0@lo:501: 00000100:00100000:2.0:1787383208.212050:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984811776:12345-0@lo:501: Request processed in 333us (400us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383208.212059:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787383208.212074:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984811776:0@lo:501: 10000000:01000000:0.0:1787383208.212112:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787383208.212119:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e463 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383208.212139:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e463 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787383208.213584:0:9961:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 241241814803ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787383208.213602:0:9961:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:0.0:1787383208.224376:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787383208.224393:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787383208.224624:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9957:x1874206984809984:12345-0@lo:700: Request processed in 52927us (53058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383208.224641:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787383208.225628:0:9957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d1500 x1874206984809984/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787383224 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383208.225650:0:9957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9957:1874206984809984:0@lo:700: 00000100:00100000:3.0:1787383208.232797:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984811904:0@lo:13: 00000100:00100000:3.0:1787383208.232898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787383208.232959:0:9962:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787383208.232987:0:9962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9962:1874206984812032:0@lo:7: 00000100:00100000:3.0:1787383208.233015:0:9962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.233045:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984812032 00000100:00100000:3.0:1787383208.233053:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984812032 00000100:00100000:3.0:1787383208.233121:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383208.233132:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9962:x1874206984812032:12345-0@lo:7: 00000100:00100000:2.0:1787383208.239597:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984811904 00000100:00100000:2.0:1787383208.239615:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984811904 00000100:00100000:2.0:1787383208.239847:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383208.239860:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984811904:12345-0@lo:13: 00002000:00000024:2.0:1787383208.239899:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923918848 avail 3692396544 00000100:00100000:2.0:1787383208.240005:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984811904:12345-0@lo:13: Request processed in 148us (7107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383208.240014:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:0.0:1787383208.241220:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:0.0:1787383208.241852:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383208.241874:0:9962:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395de40 going to sleep for 11 seconds 00000004:00080000:0.0:1787383208.246881:0:9957:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787383208.246928:0:9957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9957:1874206984812288:0@lo:7: 00000100:00100000:0.0:1787383208.247017:0:9957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383208.247065:0:9957:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a0ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383208.247239:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984812160:0@lo:13: 00000100:00100000:2.0:1787383208.247280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383208.247333:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984812160 00000100:00100000:2.0:1787383208.247342:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984812160 00000100:00100000:2.0:1787383208.247396:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787383208.247421:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984812160:12345-0@lo:13: 00002000:00000024:2.0:1787383208.247451:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923918848 avail 3692396544 00000100:00100000:2.0:1787383208.247502:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984812160:12345-0@lo:13: Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383208.247510:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787383208.247557:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f995f80 x1874206984812160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383208.247580:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984812160:0@lo:13: 00002000:00080000:3.0:1787383208.248262:0:8914:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787383208.248270:0:8914:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787383208.248325:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9962:x1874206984812032:12345-0@lo:7: Request processed in 15193us (15306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.248334:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383208.248352:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984812288 00000100:00100000:3.0:1787383208.248358:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984812288 00000100:00100000:3.0:1787383208.248529:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383208.248539:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9957:x1874206984812288:12345-0@lo:7: 00010000:00080000:0.0:1787383208.251551:0:9962:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d0a80 x1874206984812032/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787383224 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383208.251576:0:9962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9962:1874206984812032:0@lo:7: 00000004:00080000:0.0:1787383208.251595:0:9962:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787383208.251649:0:9962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9962:1874206984812416:0@lo:5: 00000100:00100000:0.0:1787383208.251727:0:9962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1787383208.258512:0:8914:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787383208.258526:0:8914:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787383208.258648:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9957:x1874206984812288:12345-0@lo:7: Request processed in 10104us (11625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383208.258660:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383208.259080:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984812416 00000100:00100000:2.0:1787383208.259091:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984812416 00000100:00100000:2.0:1787383208.259146:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383208.259154:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9962:x1874206984812416:12345-0@lo:5: 00002000:00080000:2.0:1787383208.259190:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787383208.259194:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787383208.259948:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f994e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9962:x1874206984812416:12345-0@lo:5: Request processed in 791us (8218us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787383208.259959:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787383208.260070:0:9962:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a0e000 going to sleep for 11 seconds 00010000:00080000:0.0:1787383208.260110:0:9962:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f994a80 x1874206984812416/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383224 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383208.260138:0:9962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9962:1874206984812416:0@lo:5: 00000004:00080000:0.0:1787383208.260156:0:9962:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00010000:00080000:2.0:1787383208.260889:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d2680 x1874206984811904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383208.260926:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984811904:0@lo:13: 00010000:00080000:3.0:1787383208.261108:0:9957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f995180 x1874206984812288/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787383224 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383208.261132:0:9957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9957:1874206984812288:0@lo:7: 00000004:00080000:3.0:1787383208.261144:0:9957:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787383208.261186:0:9957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9957:1874206984812544:0@lo:5: 00000100:00100000:3.0:1787383208.261239:0:9957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.261306:0:9957:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636312c1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383208.261998:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984812544 00000100:00100000:2.0:1787383208.262009:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984812544 00000100:00100000:2.0:1787383208.262107:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383208.262118:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9957:x1874206984812544:12345-0@lo:5: 00002000:00080000:2.0:1787383208.262156:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1787383208.262227:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9957:x1874206984812544:12345-0@lo:5: Request processed in 111us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383208.262234:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787383208.262294:0:9957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d3100 x1874206984812544/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383224 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383208.262308:0:9957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9957:1874206984812544:0@lo:5: 00000004:00080000:3.0:1787383208.262319:0:9957:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787383208.262354:0:9957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9957:1874206984812672:0@lo:5: 00000100:00100000:3.0:1787383208.262383:0:9957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.262974:0:9957:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636312c1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383208.263087:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984812672 00000100:00100000:0.0:1787383208.263093:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984812672 00000100:00100000:0.0:1787383208.263137:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383208.263146:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9957:x1874206984812672:12345-0@lo:5: 00002000:00080000:0.0:1787383208.263186:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1787383208.266350:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9957:x1874206984812672:12345-0@lo:5: Request processed in 3194us (3955us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787383208.266366:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787383208.267048:0:9957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d3100 x1874206984812672/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383224 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383208.267068:0:9957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9957:1874206984812672:0@lo:5: 00000004:00080000:3.0:1787383208.267086:0:9957:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787383208.267149:0:9957:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350377d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9957:1874206984812800:0@lo:900: 00000100:00100000:3.0:1787383208.267196:0:9957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383208.267273:0:9957:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636312c1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383208.276968:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984812800 00000100:00100000:0.0:1787383208.276988:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984812800 00000100:00100000:1.0:1787383208.277142:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383208.277156:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9957:x1874206984812800:12345-0@lo:900: 00000100:00100000:1.0:1787383208.277299:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9957:x1874206984812800:12345-0@lo:900: Request processed in 145us (10101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383208.277308:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787383208.277367:0:9957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350377d180 x1874206984812800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787383224 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383208.277385:0:9957:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350377d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9957:1874206984812800:0@lo:900: 00000001:00080000:2.0:1787383208.559950:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:2.0:1787383208.559973:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00010000:2.0:1787383208.603997:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383209.121137:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984812928:0@lo:41: 00000100:00100000:3.0:1787383209.121241:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383209.121713:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984812928 00000100:00100000:1.0:1787383209.121725:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984812928 00000100:00100000:1.0:1787383209.121831:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787383209.121855:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984812928:12345-0@lo:41: 00000004:00000024:1.0:1787383209.121911:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787383209.121986:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984812928:12345-0@lo:41: Request processed in 133us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383209.122011:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787383209.122290:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984812928:0@lo:41: 00000100:00100000:3.0:1787383209.628079:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350377c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984813056:0@lo:13: 00000100:00100000:3.0:1787383209.628385:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383209.628604:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984813056 00000100:00100000:2.0:1787383209.628613:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984813056 00000100:00100000:2.0:1787383209.628675:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787383209.628686:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984813056:12345-0@lo:13: 00002000:00000024:2.0:1787383209.628724:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383209.628821:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984813056:12345-0@lo:13: Request processed in 136us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383209.628829:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787383209.628854:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383209.628865:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984813184:0@lo:13: 00000100:00100000:2.0:1787383209.628896:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383209.629412:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984813184 00000100:00100000:0.0:1787383209.629419:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984813184 00000100:00100000:0.0:1787383209.629446:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383209.629454:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984813184:12345-0@lo:13: 00002000:00000024:0.0:1787383209.629468:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383209.629506:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984813184:12345-0@lo:13: Request processed in 54us (609us total) trans 0 rc 0/0 00010000:00010000:3.0:1787383209.629675:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383209.631304:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787383209.631369:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350377c700 x1874206984813056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383209.631396:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350377c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984813056:0@lo:13: 00010000:00080000:3.0:1787383209.631506:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350206ad80 x1874206984813184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383209.631581:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984813184:0@lo:13: 00000020:00000004:1.0:1787383210.560505:0:10038:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787383210.560992:0:10038:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787383210.651468:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383211.675405:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787383211.735059:0:10086:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383211.735076:0:10086:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1787383212.187041:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383212.187068:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984813312:0@lo:41: 00000100:00100000:2.0:1787383212.187137:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383212.187799:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984813312 00000100:00100000:1.0:1787383212.187809:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984813312 00000100:00100000:1.0:1787383212.187867:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383212.187876:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984813312:12345-0@lo:41: 00000004:00000024:1.0:1787383212.187924:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383212.187992:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984813312:12345-0@lo:41: Request processed in 116us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383212.187999:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787383212.188658:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984813312:0@lo:41: 00000100:00100000:1.0:1787383212.329885:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383212.335010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965891200 00000100:00100000:0.0:1787383212.335025:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965891200 00000100:00100000:0.0:1787383212.335079:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 178 00000100:00100000:0.0:1787383212.335087:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2400:x1874206965891200:12345-192.168.203.2@tcp:250: 00010000:00080000:0.0:1787383212.335116:0:6514:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 6bbc500f-638e-4719-909d-90fd49cd1aa8@192.168.203.2@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1787383212.335144:0:6514:0:(genops.c:1406:class_connect()) connect: client 6bbc500f-638e-4719-909d-90fd49cd1aa8, cookie 0xc40acec91532e46a 00000100:00080000:0.0:1787383212.335276:0:6514:0:(import.c:65:import_set_state_nolock()) ffff963503163800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383212.335342:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+5:2400:x1874206965891200:12345-192.168.203.2@tcp:250: Request processed in 254us (5475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383212.335350:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 178 00000100:00100000:3.0:1787383212.337870:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383212.337970:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965891328 00000100:00100000:2.0:1787383212.337979:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965891328 00000100:00100000:2.0:1787383212.338048:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 179 00000100:00100000:2.0:1787383212.338057:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+5:6159:x1874206965891328:12345-192.168.203.2@tcp:101: 00010000:00010000:2.0:1787383212.338071:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383212.338088:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b7400/0xc40acec91532e471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340257b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383212.338113:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b7400/0xc40acec91532e471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340257b expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383212.338123:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b7400/0xc40acec91532e471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340257b expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383212.338132:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b7400, rc 0) 00000100:00100000:2.0:1787383212.338180:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+6:6159:x1874206965891328:12345-192.168.203.2@tcp:101: Request processed in 124us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383212.338187:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 179 00000100:00100000:1.0:1787383212.340733:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383212.341092:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965891456 00000100:00100000:2.0:1787383212.341102:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965891456 00000100:00100000:2.0:1787383212.341161:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 180 00000100:00100000:2.0:1787383212.341171:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+6:6159:x1874206965891456:12345-192.168.203.2@tcp:501: 00000100:00100000:2.0:1787383212.341287:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+6:6159:x1874206965891456:12345-192.168.203.2@tcp:501: Request processed in 117us (570us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383212.341295:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 180 00000100:00100000:1.0:1787383212.353175:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383212.353278:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965891584 00000100:00100000:0.0:1787383212.353288:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965891584 00000100:00100000:0.0:1787383212.353348:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 181 00000100:00100000:0.0:1787383212.353358:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+6:6159:x1874206965891584:12345-192.168.203.2@tcp:101: 00010000:00010000:0.0:1787383212.353375:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383212.353398:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c8a00/0xc40acec91532e478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402582 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383212.353424:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c8a00/0xc40acec91532e478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402582 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383212.353435:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c8a00/0xc40acec91532e478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402582 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383212.353445:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8a00, rc 0) 00000100:00100000:0.0:1787383212.353501:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+7:6159:x1874206965891584:12345-192.168.203.2@tcp:101: Request processed in 144us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383212.353528:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 181 00000100:00100000:3.0:1787383212.356056:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383212.356253:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965891712 00000100:00100000:0.0:1787383212.356267:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965891712 00000100:00100000:0.0:1787383212.356344:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 182 00000100:00100000:0.0:1787383212.356356:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+7:6159:x1874206965891712:12345-192.168.203.2@tcp:501: 00000100:00100000:0.0:1787383212.356644:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+8:6159:x1874206965891712:12345-192.168.203.2@tcp:501: Request processed in 289us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383212.356653:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 182 00000100:00100000:1.0:1787383212.368202:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383212.368351:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965891840 00000100:00100000:2.0:1787383212.368364:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965891840 00000100:00100000:2.0:1787383212.368449:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 183 00000100:00100000:2.0:1787383212.368478:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+8:6159:x1874206965891840:12345-192.168.203.2@tcp:503: 00000100:00100000:2.0:1787383212.369140:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+8:6159:x1874206965891840:12345-192.168.203.2@tcp:503: Request processed in 661us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383212.369151:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 183 00000100:00100000:3.0:1787383212.371536:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383212.375150:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965891968 00000100:00100000:1.0:1787383212.375174:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965891968 00000100:00100000:2.0:1787383212.375651:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 184 00000100:00100000:2.0:1787383212.375675:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+8:6178:x1874206965891968:12345-192.168.203.2@tcp:502: 00000100:00100000:2.0:1787383212.375953:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+8:6178:x1874206965891968:12345-192.168.203.2@tcp:502: Request processed in 281us (4428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383212.375962:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 184 00000100:00100000:3.0:1787383212.408993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383212.410629:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965892096 00000100:00100000:0.0:1787383212.410648:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965892096 00000100:00100000:2.0:1787383212.411136:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 185 00000100:00100000:2.0:1787383212.411153:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+8:6178:x1874206965892096:12345-192.168.203.2@tcp:502: 00000100:00100000:2.0:1787383212.413051:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+8:6178:x1874206965892096:12345-192.168.203.2@tcp:502: Request processed in 1887us (4056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383212.413068:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 185 00000100:00100000:1.0:1787383212.422884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383212.423114:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965892224 00000100:00100000:2.0:1787383212.423127:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965892224 00000100:00100000:2.0:1787383212.423194:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 186 00000100:00100000:2.0:1787383212.423204:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+8:6159:x1874206965892224:12345-192.168.203.2@tcp:101: 00010000:00010000:2.0:1787383212.423225:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383212.423246:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b7000/0xc40acec91532e47f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34025b3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383212.423282:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b7000/0xc40acec91532e47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025b3 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383212.423294:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b7000/0xc40acec91532e47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025b3 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383212.423317:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b7000, rc 0) 00000100:00100000:2.0:1787383212.423382:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6159:x1874206965892224:12345-192.168.203.2@tcp:101: Request processed in 179us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383212.423390:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 186 00000100:00100000:2.0:1787383212.427173:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383212.427301:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965892352 00000100:00100000:0.0:1787383212.427315:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965892352 00000100:00100000:0.0:1787383212.427384:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 187 00000100:00100000:0.0:1787383212.427396:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6159:x1874206965892352:12345-192.168.203.2@tcp:256: 20000000:01000000:0.0:1787383212.427430:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787383212.427455:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787383212.427459:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787383212.427464:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787383212.427467:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787383212.427470:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787383212.431155:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6159:x1874206965892352:12345-192.168.203.2@tcp:256: Request processed in 3743us (3979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383212.431173:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 187 00000100:00100000:1.0:1787383212.437688:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383212.438616:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965892480 00000100:00100000:0.0:1787383212.438629:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965892480 00000100:00100000:0.0:1787383212.438732:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 188 00000100:00100000:0.0:1787383212.438744:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6159:x1874206965892480:12345-192.168.203.2@tcp:101: 00010000:00010000:0.0:1787383212.438815:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383212.438839:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c8e00/0xc40acec91532e486 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34025ba expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383212.438875:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c8e00/0xc40acec91532e486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025ba expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383212.438889:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c8e00/0xc40acec91532e486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025ba expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383212.438901:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8e00, rc 0) 00000100:00100000:0.0:1787383212.438980:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6159:x1874206965892480:12345-192.168.203.2@tcp:101: Request processed in 238us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383212.438988:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 188 00000100:00100000:2.0:1787383212.441432:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383212.441668:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965892608 00000100:00100000:0.0:1787383212.441682:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965892608 00000100:00100000:0.0:1787383212.441762:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 189 00000100:00100000:0.0:1787383212.441934:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6159:x1874206965892608:12345-192.168.203.2@tcp:501: 00000100:00100000:0.0:1787383212.442133:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6159:x1874206965892608:12345-192.168.203.2@tcp:501: Request processed in 202us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383212.442143:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 189 00000100:00100000:3.0:1787383212.444329:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383212.444664:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965892736 00000100:00100000:2.0:1787383212.444677:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965892736 00000100:00100000:2.0:1787383212.445098:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 190 00000100:00100000:2.0:1787383212.445110:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6159:x1874206965892736:12345-192.168.203.2@tcp:503: 00000100:00100000:2.0:1787383212.445290:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6159:x1874206965892736:12345-192.168.203.2@tcp:503: Request processed in 182us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383212.445298:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 190 00000100:00100000:1.0:1787383212.455823:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383212.460827:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965892864 00000100:00100000:2.0:1787383212.460850:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965892864 00000100:00100000:0.0:1787383212.462170:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 191 00000100:00100000:0.0:1787383212.462195:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6184:x1874206965892864:12345-192.168.203.2@tcp:502: 00000100:00100000:0.0:1787383212.463572:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6184:x1874206965892864:12345-192.168.203.2@tcp:502: Request processed in 1376us (7921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383212.463589:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 191 00000100:00100000:1.0:1787383212.467584:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383212.467859:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965892992 00000100:00100000:2.0:1787383212.467873:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965892992 00000100:00100000:2.0:1787383212.467947:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 192 00000100:00100000:2.0:1787383212.467959:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6184:x1874206965892992:12345-192.168.203.2@tcp:502: 00000100:00100000:2.0:1787383212.468339:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6184:x1874206965892992:12345-192.168.203.2@tcp:502: Request processed in 380us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383212.468348:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 192 00000100:00100000:3.0:1787383212.477221:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383212.477272:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383212.477401:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965893120 00000100:00100000:0.0:1787383212.477414:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965893120 00000100:00100000:0.0:1787383212.477478:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965893376 00000100:00100000:0.0:1787383212.477481:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965893376 00000100:00100000:0.0:1787383212.477892:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:0.0:1787383212.477904:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1874206965893120:12345-192.168.203.2@tcp:38: 00010000:00080000:0.0:1787383212.477946:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1787383212.478014:0:6521:0:(genops.c:1406:class_connect()) connect: client a75c5b6d-4c9e-4295-9df6-097efce92717, cookie 0xc40acec91532e48d 00000004:00100000:0.0:1787383212.478047:0:6521:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787383212.478309:0:6521:0:(import.c:65:import_set_state_nolock()) ffff963503164000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383212.478409:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2400:x1874206965893120:12345-192.168.203.2@tcp:38: Request processed in 505us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383212.478418:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:0.0:1787383212.478455:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:0.0:1787383212.478461:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1874206965893376:12345-192.168.203.2@tcp:38: 00010000:00080000:0.0:1787383212.478479:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1787383212.478543:0:6521:0:(genops.c:1406:class_connect()) connect: client a75c5b6d-4c9e-4295-9df6-097efce92717, cookie 0xc40acec91532e494 00000004:00100000:0.0:1787383212.478560:0:6521:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787383212.478715:0:6521:0:(import.c:65:import_set_state_nolock()) ffff96363f9b7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383212.478754:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2400:x1874206965893376:12345-192.168.203.2@tcp:38: Request processed in 292us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383212.478762:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00010000:00010000:1.0:1787383212.699033:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383213.211431:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383213.211603:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984813568:0@lo:400: 00000100:00100000:1.0:1787383213.211695:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383213.211817:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984813440:0@lo:400: 00000100:00100000:1.0:1787383213.211851:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383213.213657:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984813696:0@lo:400: 00000100:00100000:0.0:1787383213.213945:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383213.214042:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984814208:0@lo:400: 00000100:00100000:0.0:1787383213.214079:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383213.214101:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984814720:0@lo:400: 00000100:00100000:0.0:1787383213.214119:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383213.214142:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787383213.214147:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984813824:0@lo:400: 00000100:00100000:0.0:1787383213.214164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383213.214178:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984814336:0@lo:400: 00000100:00100000:0.0:1787383213.214199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383213.214212:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984814848:0@lo:400: 00000100:00100000:0.0:1787383213.214229:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383213.214259:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984814336 00000100:00100000:0.0:1787383213.214267:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984814336 00000100:00100000:0.0:1787383213.214322:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984814848 00000100:00100000:0.0:1787383213.214324:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984814848 00000100:00100000:0.0:1787383213.214345:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383213.214354:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984814336:12345-0@lo:400: 00000100:00100000:0.0:1787383213.214424:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984814336:12345-0@lo:400: Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383213.214431:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383213.214448:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787383213.214453:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984814848:12345-0@lo:400: 00000100:00100000:0.0:1787383213.214474:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984814848:12345-0@lo:400: Request processed in 21us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383213.214480:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787383213.214493:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383213.214497:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787383213.214527:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f995180 x1874206984814336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383213.214620:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984814336:0@lo:400: 00010000:00080000:0.0:1787383213.214638:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d918a80 x1874206984814848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383213.214645:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787383213.214662:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984814848:0@lo:400: 00000100:00100000:3.0:1787383213.214812:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984813952:0@lo:400: 00000100:00100000:3.0:1787383213.214850:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383213.214875:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984814464:0@lo:400: 00000100:00100000:3.0:1787383213.214897:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383213.214914:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984814976:0@lo:400: 00000100:00100000:3.0:1787383213.214934:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383213.214953:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787383213.214958:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984814080:0@lo:400: 00000100:00100000:3.0:1787383213.214979:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383213.214989:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984814592:0@lo:400: 00000100:00100000:3.0:1787383213.215006:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383213.215025:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984814464 00000100:00100000:3.0:1787383213.215029:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984814464 00000100:00100000:2.0:1787383213.215110:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984814976 00000100:00100000:2.0:1787383213.215114:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984814976 00000100:00100000:1.0:1787383213.215527:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984813696 00000100:00100000:1.0:1787383213.215533:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984813696 00000100:00100000:1.0:1787383213.215570:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984813952 00000100:00100000:1.0:1787383213.215574:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984813952 00000100:00100000:1.0:1787383213.215593:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787383213.215601:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984813696:12345-0@lo:400: 00000100:00100000:3.0:1787383213.217410:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383213.217426:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984814464:12345-0@lo:400: 00000100:00100000:3.0:1787383213.217527:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984814464:12345-0@lo:400: Request processed in 104us (2628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383213.217535:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383213.217651:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984813568 00000100:00100000:3.0:1787383213.217660:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984813568 00000100:00100000:3.0:1787383213.217688:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984814208 00000100:00100000:3.0:1787383213.217691:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984814208 00000100:00100000:2.0:1787383213.219622:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787383213.219639:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984814976:12345-0@lo:400: 00000100:00100000:2.0:1787383213.219762:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984814976:12345-0@lo:400: Request processed in 128us (4826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383213.219786:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787383213.219823:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984814720 00000100:00100000:2.0:1787383213.219831:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984814720 00000100:00100000:3.0:1787383213.219842:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984813824 00000100:00100000:3.0:1787383213.219848:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984813824 00000100:00100000:2.0:1787383213.219864:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984814080 00000100:00100000:2.0:1787383213.219868:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984814080 00000100:00100000:2.0:1787383213.219885:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984814592 00000100:00100000:2.0:1787383213.219888:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984814592 00000100:00100000:2.0:1787383213.219992:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787383213.220002:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984813568:12345-0@lo:400: 00000100:00100000:2.0:1787383213.220045:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984813568:12345-0@lo:400: Request processed in 46us (8352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383213.220052:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787383213.220065:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787383213.220072:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984814208:12345-0@lo:400: 00000100:00100000:3.0:1787383213.220224:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787383213.220234:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984814720:12345-0@lo:400: 00000100:00080000:0.0:1787383213.220245:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383213.220252:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383213.220256:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383213.220260:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383213.220365:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787383213.220376:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00010000:00080000:0.0:1787383213.220449:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f997480 x1874206984813568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383213.220467:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984813568:0@lo:400: 00000100:00100000:0.0:1787383213.220504:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787383213.220513:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787383213.220520:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984814080:12345-0@lo:400: 00000100:00100000:0.0:1787383213.220565:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984814080:12345-0@lo:400: Request processed in 46us (5585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383213.220572:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787383213.220584:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787383213.220589:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787383213.220594:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984814592:12345-0@lo:400: 00000100:00100000:0.0:1787383213.220617:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984814592:12345-0@lo:400: Request processed in 24us (5610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383213.220637:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787383213.220646:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787383213.220651:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787383213.220656:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984813824:12345-0@lo:400: 00000100:00100000:1.0:1787383213.223640:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984813696:12345-0@lo:400: Request processed in 8022us (9678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383213.223659:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787383213.223734:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787383213.223754:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984813952:12345-0@lo:400: 00000100:00100000:1.0:1787383213.223863:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984813952:12345-0@lo:400: Request processed in 120us (9012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383213.223870:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787383213.228306:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984813824:12345-0@lo:400: Request processed in 7634us (14125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383213.228324:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787383213.228483:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f994380 x1874206984814080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383213.228501:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984814080:0@lo:400: 00010000:00080000:0.0:1787383213.228529:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d91b100 x1874206984814592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383213.228538:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984814592:0@lo:400: 00000100:00100000:0.0:1787383213.228553:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984813952:0@lo:400: 00010000:00080000:0.0:1787383213.228565:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f995f80 x1874206984814464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383213.228573:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984814464:0@lo:400: 00010000:00080000:0.0:1787383213.228586:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d918380 x1874206984814976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383213.228594:0:3649:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787383213.228615:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984814976:0@lo:400: 00000100:00100000:0.0:1787383213.228664:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984813440 00000100:00100000:0.0:1787383213.228674:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984813440 00000100:00100000:0.0:1787383213.228758:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787383213.228797:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984813440:12345-0@lo:400: 00000100:00100000:0.0:1787383213.228892:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984813440:12345-0@lo:400: Request processed in 126us (17040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383213.228898:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00010000:00080000:1.0:1787383213.229073:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f995500 x1874206984813824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383213.229086:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984813824:0@lo:400: 00000100:00100000:1.0:1787383213.229102:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984813696:0@lo:400: 00000100:00100000:0.0:1787383213.229171:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984813440:0@lo:400: 00000100:00100000:2.0:1787383213.233606:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984814208:12345-0@lo:400: Request processed in 13517us (19508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383213.233626:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787383213.234008:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f997800 x1874206984814208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383213.234027:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984814208:0@lo:400: 00000100:00100000:3.0:1787383213.234097:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984814720:12345-0@lo:400: Request processed in 13862us (19974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383213.234106:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787383213.240682:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d91a680 x1874206984814720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383213.240706:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984814720:0@lo:400: 00000100:00100000:2.0:1787383213.493399:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383213.493734:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965893504 00000100:00100000:0.0:1787383213.493747:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965893504 00000100:00100000:0.0:1787383213.493882:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:0.0:1787383213.493894:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:0:x1874206965893504:12345-192.168.203.2@tcp:41: 00000004:00000024:0.0:1787383213.493953:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787383213.494044:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:0:x1874206965893504:12345-192.168.203.2@tcp:41: Request processed in 151us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383213.494051:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00080000:2.0:1787383213.494294:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383213.514864:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383213.516487:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383213.516560:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965893632 00000100:00100000:0.0:1787383213.516573:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965893632 00000100:00100000:3.0:1787383213.516574:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965893248 00000100:00100000:3.0:1787383213.516581:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965893248 00000100:00100000:3.0:1787383213.516671:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00080000:2.0:1787383213.516676:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383213.516689:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:0:x1874206965893248:12345-192.168.203.2@tcp:41: 00000004:00000024:3.0:1787383213.516938:0:9499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787383213.517018:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:0:x1874206965893248:12345-192.168.203.2@tcp:41: Request processed in 333us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383213.517026:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:3.0:1787383213.517048:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:3.0:1787383213.517055:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6159:x1874206965893632:12345-192.168.203.2@tcp:41: 00000004:00000024:3.0:1787383213.517067:0:9499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787383213.517107:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6159:x1874206965893632:12345-192.168.203.2@tcp:41: Request processed in 52us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383213.517114:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:0.0:1787383213.525352:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383213.525533:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965893760 00000100:00100000:1.0:1787383213.525545:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965893760 00000100:00100000:1.0:1787383213.525612:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:1.0:1787383213.525622:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6159:x1874206965893760:12345-192.168.203.2@tcp:40: 00000100:00100000:1.0:1787383213.525751:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6159:x1874206965893760:12345-192.168.203.2@tcp:40: Request processed in 129us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383213.525759:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:2.0:1787383213.530383:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383213.530452:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383213.530494:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383213.530518:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383213.530559:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965893888 00000100:00100000:2.0:1787383213.530587:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965893888 00000100:00100000:2.0:1787383213.530628:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965894016 00000100:00100000:2.0:1787383213.530631:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965894016 00000100:00100000:2.0:1787383213.530646:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:2.0:1787383213.530656:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1874206965893888:12345-192.168.203.2@tcp:8: 00010000:00080000:2.0:1787383213.530696:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1787383213.530745:0:8436:0:(genops.c:1406:class_connect()) connect: client a75c5b6d-4c9e-4295-9df6-097efce92717, cookie 0xc40acec91532e49b 00002000:00100000:2.0:1787383213.530758:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a75c5b6d-4c9e-4295-9df6-097efce92717/ffff9635036f7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383213.530813:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787383213.531019:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787383213.531054:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9635036f6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383213.531134:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2400:x1874206965893888:12345-192.168.203.2@tcp:8: Request processed in 478us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383213.531143:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:2.0:1787383213.531164:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383213.531169:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1874206965894016:12345-192.168.203.2@tcp:8: 00010000:00080000:2.0:1787383213.531187:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1787383213.531206:0:8436:0:(genops.c:1406:class_connect()) connect: client a75c5b6d-4c9e-4295-9df6-097efce92717, cookie 0xc40acec91532e4a2 00002000:00100000:2.0:1787383213.531212:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a75c5b6d-4c9e-4295-9df6-097efce92717/ffff9635036f5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383213.531224:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787383213.531369:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787383213.531389:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9635036f7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383213.531415:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2400:x1874206965894016:12345-192.168.203.2@tcp:8: Request processed in 244us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383213.531421:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:0.0:1787383213.531627:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965894272 00000100:00100000:0.0:1787383213.531633:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965894272 00000100:00100000:0.0:1787383213.531682:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 194 00000100:00100000:0.0:1787383213.531690:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2402:x1874206965894272:12345-192.168.203.2@tcp:400: 00000100:00100000:0.0:1787383213.531733:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2402:x1874206965894272:12345-192.168.203.2@tcp:400: Request processed in 44us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383213.531741:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 194 00000100:00100000:1.0:1787383213.532087:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965894144 00000100:00100000:1.0:1787383213.532094:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965894144 00000100:00100000:1.0:1787383213.532143:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:1.0:1787383213.532151:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6159:x1874206965894144:12345-192.168.203.2@tcp:900: 00000100:00100000:1.0:1787383213.532204:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6159:x1874206965894144:12345-192.168.203.2@tcp:900: Request processed in 53us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383213.532211:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:2.0:1787383213.535208:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383213.535358:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965894400 00000100:00100000:1.0:1787383213.535372:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965894400 00000100:00100000:1.0:1787383213.535609:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:1.0:1787383213.535623:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6159:x1874206965894400:12345-192.168.203.2@tcp:33: 00000004:00080000:2.0:1787383213.569972:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 34226us 00000004:00200000:2.0:1787383213.612211:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787383213.612446:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6159:x1874206965894400:12345-192.168.203.2@tcp:33: Request processed in 76820us (77247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383213.612463:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00010000:00010000:3.0:1787383213.727617:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383213.727823:0:9962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9962:1874206984815360:0@lo:700: 00000100:00100000:0.0:1787383213.727896:0:9962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383213.727981:0:9962:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e7300 going to sleep for 11 seconds 00000100:00100000:0.0:1787383213.727998:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383213.728013:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984815104:0@lo:13: 00000100:00100000:0.0:1787383213.728041:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383213.728073:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984815360 00000100:00100000:0.0:1787383213.728080:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984815360 00000100:00100000:0.0:1787383213.728124:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383213.728133:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9962:x1874206984815360:12345-0@lo:700: 00000100:00100000:1.0:1787383213.728476:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984815232:0@lo:13: 00000100:00100000:1.0:1787383213.728523:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383213.728663:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984815104 00000100:00100000:3.0:1787383213.728668:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984815104 00000100:00100000:3.0:1787383213.728690:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984815232 00000100:00100000:3.0:1787383213.728693:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984815232 00000100:00100000:3.0:1787383213.728704:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383213.728722:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984815104:12345-0@lo:13: 00002000:00000024:3.0:1787383213.728736:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787383213.728809:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984815104:12345-0@lo:13: Request processed in 97us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383213.728816:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383213.728830:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787383213.728836:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984815232:12345-0@lo:13: 00002000:00000024:3.0:1787383213.728844:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8716864 pending 0 free 3923668992 avail 3692146688 00000100:00100000:3.0:1787383213.728866:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984815232:12345-0@lo:13: Request processed in 31us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383213.728871:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787383213.728991:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503171180 x1874206984815104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383213.729011:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984815104:0@lo:13: 00010000:00080000:1.0:1787383213.729041:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d91b100 x1874206984815232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383213.729068:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984815232:0@lo:13: 00000001:00100000:2.0:1787383213.732124:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000100:00100000:0.0:1787383213.736931:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9962:x1874206984815360:12345-0@lo:700: Request processed in 8790us (9027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383213.736945:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787383213.737039:0:9962:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d918a80 x1874206984815360/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787383229 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383213.737056:0:9962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9962:1874206984815360:0@lo:700: 00000001:00100000:0.0:1787383213.739874:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000004:02000040:3.0:1787383213.740137:0:9962:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1787383213.748426:0:9962:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350377df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9962:1874206984815488:0@lo:5: 00000100:00100000:3.0:1787383213.748493:0:9962:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383213.748580:0:9962:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787383213.748952:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984815488 00000100:00100000:2.0:1787383213.748960:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984815488 00000100:00100000:2.0:1787383213.749006:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383213.749014:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9962:x1874206984815488:12345-0@lo:5: 00002000:00080000:2.0:1787383213.765855:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1787383213.765876:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1787383213.776116:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9962:x1874206984815488:12345-0@lo:5: Request processed in 27096us (27616us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787383213.776129:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787383213.776426:0:9962:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350377df80 x1874206984815488/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383229 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383213.776445:0:9962:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350377df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9962:1874206984815488:0@lo:5: 00000004:00080000:3.0:1787383213.776460:0:9962:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:1.0:1787383213.830149:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383213.831897:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965894528 00000100:00100000:2.0:1787383213.831912:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965894528 00000100:00100000:3.0:1787383213.832165:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:3.0:1787383213.832177:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:6202:x1874206965894528:12345-192.168.203.2@tcp:101: 00010000:00010000:3.0:1787383213.832198:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383213.832228:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fc400/0xc40acec91532e4a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34025eb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383213.832308:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532e4b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383213.832322:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532e4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383213.832337:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532e4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383213.832397:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787383213.832401:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383213.832417:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532e4b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383213.832441:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fc400/0xc40acec91532e4a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025eb expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383213.832460:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532e4b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025eb expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383213.832484:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebf400) 00010000:00010000:3.0:1787383213.832487:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383213.832490:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636013fde00, rc 0) 00000100:00100000:3.0:1787383213.832558:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6202:x1874206965894528:12345-192.168.203.2@tcp:101: Request processed in 382us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383213.832565:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:3.0:1787383214.237203:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984815616:0@lo:41: 00000100:00100000:3.0:1787383214.237285:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383214.237737:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984815616 00000100:00100000:0.0:1787383214.237745:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984815616 00000100:00100000:0.0:1787383214.237830:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787383214.237841:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984815616:12345-0@lo:41: 00000004:00000024:0.0:1787383214.237877:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787383214.237928:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984815616:12345-0@lo:41: Request processed in 89us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383214.237935:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787383214.239619:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984815616:0@lo:41: 00000100:00100000:2.0:1787383214.747793:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383214.747817:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984815744:0@lo:13: 00000100:00100000:2.0:1787383214.747884:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383214.747955:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984815744 00000100:00100000:2.0:1787383214.747963:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984815744 00000100:00100000:2.0:1787383214.748025:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383214.748036:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984815744:12345-0@lo:13: 00002000:00000024:2.0:1787383214.748059:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383214.748111:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984815744:12345-0@lo:13: Request processed in 76us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383214.748137:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787383214.748553:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383214.748755:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383214.748782:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984815872:0@lo:13: 00000100:00100000:1.0:1787383214.748818:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383214.748898:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984815872 00000100:00100000:2.0:1787383214.748904:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984815872 00000100:00100000:2.0:1787383214.748941:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383214.748949:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984815872:12345-0@lo:13: 00002000:00000024:2.0:1787383214.748961:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383214.748994:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984815872:12345-0@lo:13: Request processed in 46us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383214.749001:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787383214.749073:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640951c00 x1874206984815872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383214.749091:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984815872:0@lo:13: 00010000:00080000:3.0:1787383214.749212:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640952a00 x1874206984815744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383214.749238:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984815744:0@lo:13: 00010000:00010000:3.0:1787383215.772312:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383216.113495:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383216.113714:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965894656 00000100:00100000:2.0:1787383216.113726:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965894656 00000100:00100000:2.0:1787383216.113886:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:2.0:1787383216.113900:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6254:x1874206965894656:12345-192.168.203.2@tcp:41: 00000004:00000024:2.0:1787383216.113952:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787383216.114037:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6254:x1874206965894656:12345-192.168.203.2@tcp:41: Request processed in 141us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383216.114045:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00080000:0.0:1787383216.116090:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383216.119878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383216.120682:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965894784 00000100:00100000:2.0:1787383216.120706:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965894784 00000100:00100000:2.0:1787383216.120833:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:2.0:1787383216.121083:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6254:x1874206965894784:12345-192.168.203.2@tcp:41: 00000004:00000024:2.0:1787383216.121212:0:10098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787383216.121304:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6254:x1874206965894784:12345-192.168.203.2@tcp:41: Request processed in 460us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383216.121313:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00080000:0.0:1787383216.124102:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383216.128317:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383216.128509:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965894912 00000100:00100000:2.0:1787383216.128535:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965894912 00000100:00100000:2.0:1787383216.128619:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383216.128639:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6254:x1874206965894912:12345-192.168.203.2@tcp:13: 00002000:00000024:2.0:1787383216.128672:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383216.128751:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a75c5b6d-4c9e-4295-9df6-097efce92717+6:6254:x1874206965894912:12345-192.168.203.2@tcp:13: Request processed in 121us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383216.128758:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00080000:0.0:1787383216.129582:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383216.136283:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383216.136485:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965895040 00000100:00100000:2.0:1787383216.136495:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965895040 00000100:00100000:2.0:1787383216.136612:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:2.0:1787383216.136623:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a75c5b6d-4c9e-4295-9df6-097efce92717+5:6254:x1874206965895040:12345-192.168.203.2@tcp:13: 00002000:00000024:2.0:1787383216.136655:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383216.136726:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a75c5b6d-4c9e-4295-9df6-097efce92717+5:6254:x1874206965895040:12345-192.168.203.2@tcp:13: Request processed in 105us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383216.136733:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00080000:0.0:1787383216.137039:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787383216.796522:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383217.307042:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984816000:0@lo:41: 00000100:00100000:2.0:1787383217.307111:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383217.307206:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984816000 00000100:00100000:0.0:1787383217.307213:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984816000 00000100:00100000:0.0:1787383217.307279:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787383217.307287:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984816000:12345-0@lo:41: 00000004:00000024:0.0:1787383217.307320:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787383217.314896:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984816000:12345-0@lo:41: Request processed in 7599us (7773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383217.314920:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787383217.316639:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984816000:0@lo:41: 00010000:00010000:3.0:1787383217.819588:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787383217.824339:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000100:00100000:0.0:1787383218.336079:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984816256:0@lo:400: 00000100:00100000:0.0:1787383218.336144:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383218.336186:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984816768:0@lo:400: 00000100:00100000:0.0:1787383218.336208:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383218.336227:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984817280:0@lo:400: 00000100:00100000:0.0:1787383218.336247:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383218.336275:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787383218.336281:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984816384:0@lo:400: 00000100:00100000:0.0:1787383218.336305:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383218.336309:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984816512:0@lo:400: 00000100:00100000:0.0:1787383218.336322:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984816896:0@lo:400: 00000100:00100000:2.0:1787383218.336336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383218.336348:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984816256 00000100:00100000:2.0:1787383218.336353:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984817024:0@lo:400: 00000100:00100000:0.0:1787383218.336354:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984816256 00000100:00100000:2.0:1787383218.336389:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383218.336396:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984816768 00000100:00100000:0.0:1787383218.336399:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984816768 00000100:00100000:2.0:1787383218.336405:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984817536:0@lo:400: 00000100:00100000:0.0:1787383218.336421:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984817280 00000100:00100000:2.0:1787383218.336423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383218.336424:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984817280 00000100:00100000:0.0:1787383218.336436:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984816512 00000100:00100000:0.0:1787383218.336439:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984816512 00000100:00100000:2.0:1787383218.336450:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787383218.336452:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787383218.336460:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984816256:12345-0@lo:400: 00000100:00100000:2.0:1787383218.336481:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984816128:0@lo:400: 00000100:00100000:2.0:1787383218.336503:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383218.336504:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f996680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984816256:12345-0@lo:400: Request processed in 44us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.336517:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787383218.336523:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984816640:0@lo:400: 00000100:00100000:0.0:1787383218.336534:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787383218.336540:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984816768:12345-0@lo:400: 00000100:00100000:2.0:1787383218.336541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383218.336556:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984817152:0@lo:400: 00000100:00100000:0.0:1787383218.336566:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984816768:12345-0@lo:400: Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.336572:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787383218.336573:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383218.336583:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787383218.336587:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984817664:0@lo:400: 00000100:00100000:0.0:1787383218.336588:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984817280:12345-0@lo:400: 00000100:00100000:0.0:1787383218.336612:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984817280:12345-0@lo:400: Request processed in 24us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.336618:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787383218.336624:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383218.336630:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787383218.336635:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984816512:12345-0@lo:400: 00000100:00100000:2.0:1787383218.336655:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984817024 00000100:00100000:2.0:1787383218.336659:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984817024 00000100:00100000:0.0:1787383218.336661:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984816512:12345-0@lo:400: Request processed in 27us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.336667:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787383218.336693:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984817536 00000100:00100000:2.0:1787383218.336696:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984817536 00000100:00100000:2.0:1787383218.336707:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984817152 00000100:00100000:0.0:1787383218.336707:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984816384 00000100:00100000:2.0:1787383218.336709:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984817152 00000100:00100000:0.0:1787383218.336710:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984816384 00000100:00100000:2.0:1787383218.336719:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984817664 00000100:00100000:2.0:1787383218.336722:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984817664 00000100:00100000:0.0:1787383218.336723:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984816640 00000100:00100000:0.0:1787383218.336725:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984816640 00000100:00100000:2.0:1787383218.336734:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383218.336736:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787383218.336739:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984817024:12345-0@lo:400: 00000100:00100000:0.0:1787383218.336741:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984816384:12345-0@lo:400: 00000100:00100000:0.0:1787383218.336874:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984816384:12345-0@lo:400: Request processed in 132us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.336881:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787383218.336897:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383218.336910:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984816640:12345-0@lo:400: 00000100:00100000:0.0:1787383218.336939:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984816640:12345-0@lo:400: Request processed in 31us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.336945:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787383218.336963:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383218.336967:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383218.336970:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383218.337084:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383218.337094:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984817536:12345-0@lo:400: 00000100:00100000:3.0:1787383218.337129:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984817536:12345-0@lo:400: Request processed in 38us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383218.337135:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383218.337149:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787383218.337155:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984817152:12345-0@lo:400: 00000100:00100000:3.0:1787383218.337190:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984817152:12345-0@lo:400: Request processed in 35us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383218.337195:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787383218.337206:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787383218.337212:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984817664:12345-0@lo:400: 00000100:00100000:3.0:1787383218.337254:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984817664:12345-0@lo:400: Request processed in 41us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383218.337260:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787383218.337312:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984816128 00000100:00100000:3.0:1787383218.337320:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984816128 00000100:00100000:3.0:1787383218.337347:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787383218.337352:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984816128:12345-0@lo:400: 00000100:00100000:3.0:1787383218.337379:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984816128:12345-0@lo:400: Request processed in 27us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383218.337385:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787383218.337414:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383218.337436:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984817408:0@lo:400: 00000100:00100000:3.0:1787383218.337458:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383218.337494:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984816256:0@lo:400: 00000100:00100000:3.0:1787383218.337505:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984816768:0@lo:400: 00000100:00100000:3.0:1787383218.337514:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984817280:0@lo:400: 00000100:00100000:3.0:1787383218.337534:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984816384:0@lo:400: 00000100:00100000:3.0:1787383218.337550:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984816896 00000100:00100000:3.0:1787383218.337553:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984816896 00000100:00100000:0.0:1787383218.338889:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984816128:0@lo:400: 00000100:00100000:0.0:1787383218.338908:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984816640:0@lo:400: 00010000:00080000:0.0:1787383218.338923:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f997800 x1874206984817152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383218.338933:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984817152:0@lo:400: 00010000:00080000:0.0:1787383218.338943:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f995f80 x1874206984817664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383218.338952:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984817664:0@lo:400: 00000100:00100000:0.0:1787383218.338964:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984816512:0@lo:400: 00010000:00080000:0.0:1787383218.338974:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d91a680 x1874206984817024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383218.338995:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984817024:0@lo:400: 00010000:00080000:0.0:1787383218.339007:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f994000 x1874206984817536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383218.339014:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984817536:0@lo:400: 00000100:00100000:2.0:1787383218.339379:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984817024:12345-0@lo:400: Request processed in 2622us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383218.339391:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383218.341248:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984817408 00000100:00100000:3.0:1787383218.341272:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984817408 00000100:00100000:3.0:1787383218.341309:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787383218.341319:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984816896:12345-0@lo:400: 00000100:00100000:2.0:1787383218.341505:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787383218.341516:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984817408:12345-0@lo:400: 00000100:00080000:0.0:1787383218.341656:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383218.341674:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984817408:12345-0@lo:400: Request processed in 160us (4214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383218.341715:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787383218.342430:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984816896:12345-0@lo:400: Request processed in 1109us (5011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383218.342439:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1787383218.342491:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d91b100 x1874206984816896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383218.342504:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984816896:0@lo:400: 00010000:00080000:3.0:1787383218.342516:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f995500 x1874206984817408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383218.342526:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984817408:0@lo:400: 00000001:02000400:0.0:1787383218.707240:0:10185:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787383218.743858:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383218.743915:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383218.743935:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965895168 00000100:00100000:0.0:1787383218.743946:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965895168 00000100:00100000:3.0:1787383218.743951:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383218.744067:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965895424 00000100:00100000:1.0:1787383218.744072:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965895424 00000100:00100000:1.0:1787383218.744118:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:1.0:1787383218.744127:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965895424:12345-192.168.203.2@tcp:400: 00000100:00100000:0.0:1787383218.746577:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 196 00000100:00100000:0.0:1787383218.746600:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2404:x1874206965895168:12345-192.168.203.2@tcp:400: 00000100:00100000:1.0:1787383218.746670:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965895424:12345-192.168.203.2@tcp:400: Request processed in 2540us (2762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383218.746709:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00080000:1.0:1787383218.746741:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383218.746975:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965895680 00000100:00100000:2.0:1787383218.746995:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965895680 00000100:00100000:2.0:1787383218.747044:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:2.0:1787383218.747053:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965895680:12345-192.168.203.2@tcp:400: 00000100:00100000:3.0:1787383218.747235:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383218.747264:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383218.747290:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965895296 00000100:00100000:3.0:1787383218.747294:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965895296 00000100:00100000:3.0:1787383218.747324:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:3.0:1787383218.747331:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965895296:12345-192.168.203.2@tcp:400: 00000100:00100000:3.0:1787383218.747365:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965895296:12345-192.168.203.2@tcp:400: Request processed in 35us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383218.747372:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:3.0:1787383218.747391:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965895552 00000100:00100000:3.0:1787383218.747394:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965895552 00000100:00100000:3.0:1787383218.747447:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:3.0:1787383218.747454:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965895552:12345-192.168.203.2@tcp:400: 00000100:00100000:3.0:1787383218.747565:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965895552:12345-192.168.203.2@tcp:400: Request processed in 111us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383218.747572:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:0.0:1787383218.748295:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2404:x1874206965895168:12345-192.168.203.2@tcp:400: Request processed in 1701us (4441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383218.748311:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 196 00000100:00080000:0.0:1787383218.748365:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383218.748481:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383218.748484:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383218.750800:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965895680:12345-192.168.203.2@tcp:400: Request processed in 3713us (6816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383218.750815:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:3.0:1787383218.843330:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984817792:0@lo:13: 00000100:00100000:3.0:1787383218.843408:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383218.843458:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383218.843465:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984817920:0@lo:13: 00000100:00100000:3.0:1787383218.843488:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383218.844083:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984817792 00000100:00100000:3.0:1787383218.844093:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984817792 00000100:00100000:3.0:1787383218.844128:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984817920 00000100:00100000:3.0:1787383218.844131:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984817920 00000100:00100000:3.0:1787383218.844147:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787383218.844155:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984817792:12345-0@lo:13: 00002000:00000024:3.0:1787383218.844181:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383218.844301:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984817792:12345-0@lo:13: Request processed in 145us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383218.844308:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787383218.844324:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787383218.844330:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874206984817920:12345-0@lo:13: 00002000:00000024:3.0:1787383218.844339:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383218.844363:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874206984817920:12345-0@lo:13: Request processed in 33us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383218.844368:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787383218.844402:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96364098f100 x1874206984817920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383218.844430:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984817920:0@lo:13: 00010000:00080000:3.0:1787383218.844443:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503172a00 x1874206984817792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383218.844451:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984817792:0@lo:13: 00010000:00010000:0.0:1787383218.848970:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787383218.850737:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000100:00100000:1.0:1787383219.355126:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383219.355154:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984818048:0@lo:41: 00000100:00100000:1.0:1787383219.355231:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383219.355364:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984818048 00000100:00100000:0.0:1787383219.355372:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984818048 00000100:00100000:0.0:1787383219.355418:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383219.355427:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984818048:12345-0@lo:41: 00000004:00000024:0.0:1787383219.355460:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787383219.355515:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984818048:12345-0@lo:41: Request processed in 89us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383219.355523:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787383219.355814:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984818048:0@lo:41: 00010000:00010000:0.0:1787383219.867095:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383219.869717:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383219.869753:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984818176:0@lo:13: 00000100:00100000:0.0:1787383219.869861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383219.869940:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984818176 00000100:00100000:0.0:1787383219.869949:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984818176 00000100:00100000:0.0:1787383219.870012:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787383219.870021:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984818176:12345-0@lo:13: 00002000:00000024:0.0:1787383219.870059:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383219.870121:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984818176:12345-0@lo:13: Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383219.870128:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787383219.870179:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f994000 x1874206984818176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383219.870198:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984818176:0@lo:13: 00000100:00100000:3.0:1787383219.874335:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383219.874370:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984818304:0@lo:13: 00000100:00100000:3.0:1787383219.874459:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383219.876067:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984818304 00000100:00100000:2.0:1787383219.876086:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984818304 00000100:00100000:2.0:1787383219.876157:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787383219.876169:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984818304:12345-0@lo:13: 00002000:00000024:2.0:1787383219.876202:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383219.876813:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984818304:12345-0@lo:13: Request processed in 645us (2351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383219.876823:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787383219.876987:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96364098ca80 x1874206984818304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383219.877013:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984818304:0@lo:13: 00000001:00080000:0.0:1787383219.878119:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1787383220.891505:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383221.915734:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383222.427509:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984818432:0@lo:41: 00000100:00100000:3.0:1787383222.427582:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.427738:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984818432 00000100:00100000:1.0:1787383222.427746:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984818432 00000100:00100000:1.0:1787383222.427827:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787383222.427836:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984818432:12345-0@lo:41: 00000004:00000024:1.0:1787383222.427878:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383222.427929:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984818432:12345-0@lo:41: Request processed in 93us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.427936:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787383222.428072:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984818432:0@lo:41: 00000020:00000080:2.0:1787383222.539467:0:10333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff89b55450 00000020:00000080:2.0:1787383222.539484:0:10333:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787383222.539489:0:10333:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787383222.539497:0:10333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff89b576e0 20000000:00000080:2.0:1787383222.539504:0:10333:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96362d8a2800 uarg=0000000000000000 20000000:01000000:2.0:1787383222.539543:0:10333:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787383222.539546:0:10333:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787383222.539549:0:10333:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787383222.539554:0:10333:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787383222.539559:0:10333:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787383222.539697:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787383222.539700:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787383222.540162:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1787383222.540395:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1787383222.540428:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1787383222.540455:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1787383222.540465:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787383222.540466:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787383222.541035:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1787383222.541348:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1787383222.541376:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1787383222.541393:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1787383222.541403:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787383222.541405:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787383222.541725:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1787383222.541973:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1787383222.541994:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1787383222.542007:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1787383222.542018:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787383222.542020:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787383222.542301:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1787383222.542447:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1787383222.542470:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1787383222.542485:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1787383222.542493:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787383222.542495:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787383222.542920:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1787383222.543062:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1787383222.543084:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1787383222.543098:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:2.0:1787383222.543110:0:10333:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787383222.543132:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543151:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963601655c00/0xc40acec91532e352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e34b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543159:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963601654000/0xc40acec91532e37c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e375 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543167:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636102b6000/0xc40acec91532e3bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e3b4 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543184:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963601655600/0xc40acec91532e3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e3c2 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543192:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636352c1200/0xc40acec91532e3d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e3d0 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543199:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636352c0e00/0xc40acec91532e3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e3ec expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543206:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636102b6c00/0xc40acec91532e41d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e416 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543213:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636352c0800/0xc40acec91532e439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e432 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543220:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c9000/0xc40acec91532e463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e45c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543230:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636102b7400/0xc40acec91532e471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340257b expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543237:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c8a00/0xc40acec91532e478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402582 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543245:0:10333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543281:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c8a00/0xc40acec91532e478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402582 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543305:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636113c8a00/0xc40acec91532e478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402582 expref: 9 pid: 6514 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.543320:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984818560:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383222.543489:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636102b7400/0xc40acec91532e471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340257b expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543499:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636102b7400/0xc40acec91532e471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340257b expref: 9 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.543508:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984818688:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383222.543542:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c9000/0xc40acec91532e463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e45c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543550:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636113c9000/0xc40acec91532e463 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e45c expref: 23 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.543559:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984818816:0@lo:104: 00000100:00100000:2.0:1787383222.543669:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383222.543729:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636352c0800/0xc40acec91532e439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e432 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543737:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636352c0800/0xc40acec91532e439 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e432 expref: 23 pid: 6515 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.543746:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984818944:0@lo:104: 00000100:00100000:2.0:1787383222.543806:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383222.543843:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636102b6c00/0xc40acec91532e41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e416 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543852:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636102b6c00/0xc40acec91532e41d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e416 expref: 23 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.543862:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819072:0@lo:104: 00000100:00100000:2.0:1787383222.543881:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383222.543894:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636352c0e00/0xc40acec91532e3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e3ec expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543901:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636352c0e00/0xc40acec91532e3f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e3ec expref: 23 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.543909:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819200:0@lo:104: 00000100:00100000:2.0:1787383222.543925:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383222.543937:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636352c1200/0xc40acec91532e3d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e3d0 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543944:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636352c1200/0xc40acec91532e3d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e3d0 expref: 23 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.543952:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819328:0@lo:104: 00010000:00010000:2.0:1787383222.543967:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963601655600/0xc40acec91532e3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e3c2 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.543974:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff963601655600/0xc40acec91532e3c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e3c2 expref: 23 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.543982:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819456:0@lo:104: 00010000:00010000:2.0:1787383222.544014:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636102b6000/0xc40acec91532e3bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e3b4 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.544022:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636102b6000/0xc40acec91532e3bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e3b4 expref: 23 pid: 6515 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.544031:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819584:0@lo:104: 00010000:00010000:2.0:1787383222.544053:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963601654000/0xc40acec91532e37c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e375 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.544061:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff963601654000/0xc40acec91532e37c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e375 expref: 23 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.544069:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819712:0@lo:104: 00010000:00010000:2.0:1787383222.544089:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963601655c00/0xc40acec91532e352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e34b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383222.544097:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff963601655c00/0xc40acec91532e352 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e34b expref: 23 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.544105:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819840:0@lo:104: 00000100:00100000:2.0:1787383222.544119:0:10333:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636312c1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787383222.544192:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787383222.544209:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.544220:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.544228:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.544235:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.544243:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.544250:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984818816 00000100:00100000:1.0:1787383222.544256:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984818816 00000100:00100000:1.0:1787383222.544289:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984818944 00000100:00100000:1.0:1787383222.544292:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984818944 00000100:00100000:1.0:1787383222.544301:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984819072 00000100:00100000:1.0:1787383222.544304:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984819072 00000100:00100000:1.0:1787383222.544312:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984819200 00000100:00100000:1.0:1787383222.544315:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984819200 00000100:00100000:1.0:1787383222.544324:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984819328 00000100:00100000:1.0:1787383222.544326:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984819328 00000100:00100000:1.0:1787383222.544335:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984819456 00000100:00100000:1.0:1787383222.544337:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984819456 00000100:00100000:1.0:1787383222.544345:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984819584 00000100:00100000:1.0:1787383222.544347:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984819584 00000100:00100000:1.0:1787383222.544355:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984819712 00000100:00100000:1.0:1787383222.544357:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984819712 00000100:00100000:1.0:1787383222.544366:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984819840 00000100:00100000:1.0:1787383222.544375:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984819840 00000100:00100000:1.0:1787383222.544390:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787383222.544399:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+11:10333:x1874206984818816:12345-0@lo:104: 00010000:00010000:1.0:1787383222.544411:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e463 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.544470:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383222.544476:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+11:10333:x1874206984818816:12345-0@lo:104: Request processed in 79us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.544482:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787383222.544498:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787383222.544504:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+10:10333:x1874206984818944:12345-0@lo:104: 00010000:00010000:1.0:1787383222.544511:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e439 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.544542:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787383222.544546:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+10:10333:x1874206984818944:12345-0@lo:104: Request processed in 43us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.544551:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787383222.544563:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787383222.544569:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+9:10333:x1874206984819072:12345-0@lo:104: 00010000:00010000:1.0:1787383222.544575:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e41d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.544613:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787383222.544618:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+9:10333:x1874206984819072:12345-0@lo:104: Request processed in 51us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.544623:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787383222.544642:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383222.544647:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363da54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+8:10333:x1874206984819200:12345-0@lo:104: 00010000:00010000:1.0:1787383222.544664:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e3f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.544691:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787383222.544696:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363da54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+8:10333:x1874206984819200:12345-0@lo:104: Request processed in 50us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.544701:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383222.544727:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787383222.544733:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503171500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+7:10333:x1874206984819328:12345-0@lo:104: 00010000:00010000:1.0:1787383222.544740:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e3d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.544787:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787383222.544795:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503171500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+7:10333:x1874206984819328:12345-0@lo:104: Request processed in 63us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.544801:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787383222.544813:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787383222.544818:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+6:10333:x1874206984819456:12345-0@lo:104: 00010000:00010000:1.0:1787383222.544825:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e3c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.544847:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787383222.544851:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503173100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+6:10333:x1874206984819456:12345-0@lo:104: Request processed in 34us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.544856:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787383222.544874:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383222.544880:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503685500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+5:10333:x1874206984819584:12345-0@lo:104: 00010000:00010000:1.0:1787383222.544886:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e3bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.544913:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787383222.544917:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503685500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+5:10333:x1874206984819584:12345-0@lo:104: Request processed in 39us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.544923:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383222.544934:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787383222.544939:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+4:10333:x1874206984819712:12345-0@lo:104: 00010000:00010000:1.0:1787383222.544946:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e37c expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.544968:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1787383222.544973:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+4:10333:x1874206984819712:12345-0@lo:104: Request processed in 34us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.544978:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787383222.544990:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383222.544995:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+3:10333:x1874206984819840:12345-0@lo:104: 00010000:00010000:1.0:1787383222.545002:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e352 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545024:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1787383222.545028:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+3:10333:x1874206984819840:12345-0@lo:104: Request processed in 35us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.545033:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1787383222.545058:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1787383222.545064:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e463 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545071:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b6800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383222.545076:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e463 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545085:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e463 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383222.545093:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e463 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383222.545098:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383222.545123:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e463 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545128:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383222.545146:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e463 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545153:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b6800/0xc40acec91532e45c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e463 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545165:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1787383222.545169:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e439 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545174:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0600 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383222.545178:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e439 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545189:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e439 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383222.545196:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e439 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383222.545201:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383222.545212:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e439 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545217:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383222.545221:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e439 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545228:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e439 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545236:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787383222.545239:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e41d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545244:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7600 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383222.545247:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e41d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545254:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e41d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383222.545259:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e41d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383222.545269:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383222.545282:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e41d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545287:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383222.545301:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e41d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545309:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e41d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545317:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787383222.545320:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e3f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545325:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383222.545328:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e3f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545334:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e3f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383222.545339:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e3f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383222.545344:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383222.545356:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e3f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545362:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383222.545373:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e3f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545379:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532e3ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e3f3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545388:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787383222.545391:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e3d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545397:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383222.545400:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e3d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545406:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e3d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383222.545411:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e3d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383222.545416:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383222.545429:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e3d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545435:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383222.545439:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e3d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545446:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e3d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e3d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545455:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787383222.545464:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e3c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545469:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8200 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383222.545472:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e3c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545480:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e3c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383222.545486:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e3c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383222.545491:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383222.545503:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e3c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545509:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383222.545513:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e3c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545518:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c8200/0xc40acec91532e3c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e3c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545526:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787383222.545529:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e3bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545534:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654600 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383222.545537:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e3bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545553:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e3bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383222.545560:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e3bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383222.545565:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383222.545577:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e3bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545583:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383222.545587:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e3bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545594:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601654600/0xc40acec91532e3b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e3bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545602:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383222.545605:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e37c expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545610:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383222.545613:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e37c expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545620:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e37c expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383222.545626:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e37c expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383222.545635:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383222.545646:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e37c expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545662:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383222.545666:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e37c expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545673:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e37c expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545680:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383222.545683:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e352 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545688:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9400 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383222.545691:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e352 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545697:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e352 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383222.545702:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e352 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383222.545707:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383222.545717:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e352 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545722:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383222.545733:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e352 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545740:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c9400/0xc40acec91532e34b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e352 expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.545752:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383222.545754:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383222.545755:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383222.545780:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383222.545793:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984819968:0@lo:103: 00000100:00100000:1.0:1787383222.545829:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.545851:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984820480:0@lo:103: 00000100:00100000:1.0:1787383222.545869:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.545883:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984820992:0@lo:103: 00000100:00100000:1.0:1787383222.545899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.545915:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787383222.545920:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984820096:0@lo:103: 00000100:00100000:1.0:1787383222.545936:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.545947:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984820608:0@lo:103: 00000100:00100000:1.0:1787383222.545961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.545985:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984820224:0@lo:103: 00000100:00100000:1.0:1787383222.546006:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.546016:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984820736:0@lo:103: 00000100:00100000:1.0:1787383222.546033:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.546043:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787383222.546048:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984820352:0@lo:103: 00000100:00100000:1.0:1787383222.546088:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.546098:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984820864:0@lo:103: 00000100:00100000:1.0:1787383222.546129:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383222.546155:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984819968 00000100:00100000:1.0:1787383222.546160:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984819968 00010000:00010000:1.0:1787383222.546191:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c9000/0xc40acec91532e463 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e45c expref: 24 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383222.546208:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984820480 00000100:00100000:1.0:1787383222.546210:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984820480 00010000:00010000:1.0:1787383222.546220:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636352c1200/0xc40acec91532e3d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e3d0 expref: 25 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383222.546229:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984820992 00000100:00100000:1.0:1787383222.546231:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984820992 00010000:00010000:1.0:1787383222.546238:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963601655c00/0xc40acec91532e352 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e34b expref: 26 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383222.546247:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984820096 00000100:00100000:1.0:1787383222.546249:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984820096 00010000:00010000:1.0:1787383222.546256:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636352c0800/0xc40acec91532e439 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e432 expref: 27 pid: 6515 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383222.546264:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984820608 00000100:00100000:1.0:1787383222.546266:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984820608 00010000:00010000:1.0:1787383222.546275:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963601655600/0xc40acec91532e3c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e3c2 expref: 28 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383222.546284:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984820224 00000100:00100000:1.0:1787383222.546286:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984820224 00010000:00010000:1.0:1787383222.546294:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636102b6c00/0xc40acec91532e41d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e416 expref: 29 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383222.546315:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984820736 00000100:00100000:1.0:1787383222.546318:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984820736 00010000:00010000:1.0:1787383222.546330:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636102b6000/0xc40acec91532e3bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e3b4 expref: 30 pid: 6515 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383222.546340:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984820352 00000100:00100000:1.0:1787383222.546342:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984820352 00010000:00010000:1.0:1787383222.546351:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636352c0e00/0xc40acec91532e3f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e3ec expref: 31 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383222.546361:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984820864 00000100:00100000:1.0:1787383222.546363:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984820864 00010000:00010000:1.0:1787383222.546373:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963601654000/0xc40acec91532e37c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e375 expref: 32 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383222.546385:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787383222.546391:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+32:3647:x1874206984819968:12345-0@lo:103: 00010000:00010000:1.0:1787383222.546401:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383222.546406:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c9000/0xc40acec91532e463 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e45c expref: 32 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546415:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c9000/0xc40acec91532e463 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e45c expref: 32 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546431:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383222.546462:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+32:3647:x1874206984819968:12345-0@lo:103: Request processed in 71us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.546468:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787383222.546504:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787383222.546517:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+31:3647:x1874206984820480:12345-0@lo:103: 00010000:00010000:1.0:1787383222.546524:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383222.546528:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636352c1200/0xc40acec91532e3d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e3d0 expref: 31 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546536:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636352c1200/0xc40acec91532e3d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e3d0 expref: 31 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546546:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383222.546567:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+31:3647:x1874206984820480:12345-0@lo:103: Request processed in 52us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.546572:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787383222.546584:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787383222.546589:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+30:3647:x1874206984820992:12345-0@lo:103: 00010000:00010000:1.0:1787383222.546595:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383222.546599:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963601655c00/0xc40acec91532e352 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e34b expref: 30 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546606:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963601655c00/0xc40acec91532e352 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e34b expref: 30 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546615:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383222.546633:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+30:3647:x1874206984820992:12345-0@lo:103: Request processed in 43us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.546638:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787383222.546659:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383222.546665:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+29:3647:x1874206984820096:12345-0@lo:103: 00010000:00010000:1.0:1787383222.546671:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383222.546681:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636352c0800/0xc40acec91532e439 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e432 expref: 29 pid: 6515 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546688:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636352c0800/0xc40acec91532e439 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e432 expref: 29 pid: 6515 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546698:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383222.546719:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+29:3647:x1874206984820096:12345-0@lo:103: Request processed in 55us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.546725:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383222.546738:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787383222.546743:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+28:3647:x1874206984820608:12345-0@lo:103: 00010000:00010000:1.0:1787383222.546750:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383222.546754:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963601655600/0xc40acec91532e3c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e3c2 expref: 28 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546762:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963601655600/0xc40acec91532e3c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e3c2 expref: 28 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546792:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383222.546813:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+28:3647:x1874206984820608:12345-0@lo:103: Request processed in 70us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.546818:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787383222.546829:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787383222.546834:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502017800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+27:3649:x1874206984820224:12345-0@lo:103: 00010000:00010000:1.0:1787383222.546841:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383222.546845:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636102b6c00/0xc40acec91532e41d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e416 expref: 27 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546862:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636102b6c00/0xc40acec91532e41d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e416 expref: 27 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546871:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383222.546895:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502017800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+27:3649:x1874206984820224:12345-0@lo:103: Request processed in 61us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.546900:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787383222.546911:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383222.546916:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502017100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+26:3649:x1874206984820736:12345-0@lo:103: 00010000:00010000:1.0:1787383222.546923:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383222.546927:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636102b6000/0xc40acec91532e3bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e3b4 expref: 26 pid: 6515 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546935:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636102b6000/0xc40acec91532e3bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e3b4 expref: 26 pid: 6515 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546944:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383222.546959:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502017100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+26:3649:x1874206984820736:12345-0@lo:103: Request processed in 43us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.546965:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383222.546973:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787383222.546979:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+25:3649:x1874206984820352:12345-0@lo:103: 00010000:00010000:1.0:1787383222.546985:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383222.546989:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636352c0e00/0xc40acec91532e3f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e3ec expref: 25 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.546997:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636352c0e00/0xc40acec91532e3f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e3ec expref: 25 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.547012:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383222.547033:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+25:3649:x1874206984820352:12345-0@lo:103: Request processed in 54us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.547038:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787383222.547065:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383222.547071:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984820864:12345-0@lo:103: 00010000:00010000:1.0:1787383222.547078:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383222.547083:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963601654000/0xc40acec91532e37c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e375 expref: 24 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.547090:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963601654000/0xc40acec91532e37c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e375 expref: 24 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.547099:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383222.547118:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984820864:12345-0@lo:103: Request processed in 47us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.547124:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383222.547173:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984820352:0@lo:103: 00000100:00100000:1.0:1787383222.547181:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984820864:0@lo:103: 00000100:00100000:1.0:1787383222.547188:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984820224:0@lo:103: 00000100:00100000:1.0:1787383222.547194:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984820736:0@lo:103: 00000100:00100000:1.0:1787383222.547221:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984820096:0@lo:103: 00000100:00100000:1.0:1787383222.547228:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984820608:0@lo:103: 00000100:00100000:1.0:1787383222.547235:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984819968:0@lo:103: 00000100:00100000:1.0:1787383222.547249:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984820480:0@lo:103: 00000100:00100000:1.0:1787383222.547256:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984820992:0@lo:103: 00010000:00010000:2.0:1787383222.547467:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9000/0xc40acec91532e463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e45c expref: 23 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.547480:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984818816:0@lo:104: 00010000:00010000:2.0:1787383222.547490:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c0800/0xc40acec91532e439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e432 expref: 22 pid: 6515 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.547498:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984818944:0@lo:104: 00010000:00010000:2.0:1787383222.547516:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b6c00/0xc40acec91532e41d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e416 expref: 21 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.547525:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819072:0@lo:104: 00010000:00010000:2.0:1787383222.547534:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c0e00/0xc40acec91532e3f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e3ec expref: 20 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.547542:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819200:0@lo:104: 00010000:00010000:2.0:1787383222.547551:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c1200/0xc40acec91532e3d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e3d0 expref: 19 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.547559:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819328:0@lo:104: 00010000:00010000:2.0:1787383222.547567:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963601655600/0xc40acec91532e3c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e3c2 expref: 18 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.547575:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819456:0@lo:104: 00010000:00010000:2.0:1787383222.547633:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b6000/0xc40acec91532e3bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e3b4 expref: 17 pid: 6515 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.547643:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819584:0@lo:104: 00010000:00010000:2.0:1787383222.547664:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963601654000/0xc40acec91532e37c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e375 expref: 16 pid: 6512 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.547673:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819712:0@lo:104: 00010000:00010000:2.0:1787383222.547683:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963601655c00/0xc40acec91532e352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e34b expref: 15 pid: 6514 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383222.547689:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984819840:0@lo:104: 00000100:00100000:2.0:1787383222.553102:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984818560:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383222.553226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383222.553298:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383222.553356:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874206984818688:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383222.553403:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383222.560180:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965895808 00000100:00100000:1.0:1787383222.560194:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965895808 00010000:00010000:1.0:1787383222.560239:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c8a00/0xc40acec91532e478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402582 expref: 10 pid: 6514 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383222.560280:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965895936 00000100:00100000:1.0:1787383222.560283:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965895936 00010000:00010000:1.0:1787383222.560296:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636102b7400/0xc40acec91532e471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340257b expref: 11 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383222.560325:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:1.0:1787383222.560335:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:2401:x1874206965895808:12345-192.168.203.2@tcp:103: 00010000:00010000:1.0:1787383222.560351:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383222.560357:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c8a00/0xc40acec91532e478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402582 expref: 11 pid: 6514 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560370:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c8a00/0xc40acec91532e478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402582 expref: 11 pid: 6514 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560389:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c8a00/0xc40acec91532e478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402582 expref: 11 pid: 6514 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560403:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383222.560459:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2401:x1874206965895808:12345-192.168.203.2@tcp:103: Request processed in 125us (7233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.560466:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:1.0:1787383222.560500:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:1.0:1787383222.560507:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:2401:x1874206965895936:12345-192.168.203.2@tcp:103: 00010000:00010000:1.0:1787383222.560515:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383222.560520:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636102b7400/0xc40acec91532e471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340257b expref: 9 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560529:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636102b7400/0xc40acec91532e471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340257b expref: 9 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560538:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b7400/0xc40acec91532e471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340257b expref: 9 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560549:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560558:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560572:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560580:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560587:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560593:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560599:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383222.560608:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560617:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560631:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.560641:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383222.560669:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+8:2401:x1874206965895936:12345-192.168.203.2@tcp:103: Request processed in 162us (7371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383222.560675:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 34 00010000:00010000:3.0:1787383222.563807:0:10333:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383222.563827:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383222.563834:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b7e00/0xc40acec91532e4b7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383222.939080:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383223.452019:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984821376:0@lo:400: 00000100:00100000:2.0:1787383223.452086:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383223.452152:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984821888:0@lo:400: 00000100:00100000:2.0:1787383223.452178:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383223.452199:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984822400:0@lo:400: 00000100:00100000:2.0:1787383223.452217:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383223.452241:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787383223.452246:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984821248:0@lo:400: 00000100:00100000:2.0:1787383223.452265:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383223.452279:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984821760:0@lo:400: 00000100:00100000:2.0:1787383223.452299:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383223.452312:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984822272:0@lo:400: 00000100:00100000:0.0:1787383223.452472:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984821376 00000100:00100000:0.0:1787383223.452480:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984821376 00000100:00100000:0.0:1787383223.452527:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787383223.452536:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984821376:12345-0@lo:400: 00000100:00100000:0.0:1787383223.452590:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984821376:12345-0@lo:400: Request processed in 53us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383223.452597:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787383223.456865:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984821504:0@lo:400: 00000100:00100000:3.0:1787383223.456960:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984821888 00000100:00100000:3.0:1787383223.456984:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984821888 00000100:00100000:3.0:1787383223.457047:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984822400 00000100:00100000:3.0:1787383223.457050:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984822400 00000100:00100000:3.0:1787383223.457066:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984821248 00000100:00100000:3.0:1787383223.457069:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984821248 00000100:00100000:3.0:1787383223.457079:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984821760 00000100:00100000:3.0:1787383223.457081:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984821760 00000100:00100000:3.0:1787383223.457096:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787383223.457103:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984821888:12345-0@lo:400: 00000100:00100000:3.0:1787383223.457162:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984821888:12345-0@lo:400: Request processed in 58us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383223.457169:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787383223.457185:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787383223.457191:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984822400:12345-0@lo:400: 00000100:00100000:3.0:1787383223.457225:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984822400:12345-0@lo:400: Request processed in 34us (5006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383223.457231:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787383223.457241:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787383223.457246:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984821248:12345-0@lo:400: 00000100:00100000:3.0:1787383223.457270:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984821248:12345-0@lo:400: Request processed in 24us (5003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383223.457276:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787383223.457285:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787383223.457291:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984821760:12345-0@lo:400: 00000100:00100000:3.0:1787383223.457316:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984821760:12345-0@lo:400: Request processed in 26us (5017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383223.457321:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787383223.457538:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984821120:0@lo:400: 00000100:00100000:1.0:1787383223.457576:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383223.457615:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984821632:0@lo:400: 00000100:00100000:1.0:1787383223.457640:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383223.457676:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984822144:0@lo:400: 00000100:00100000:1.0:1787383223.457696:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383223.457712:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984822656:0@lo:400: 00000100:00100000:1.0:1787383223.457728:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383223.457786:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984821120 00000100:00100000:1.0:1787383223.457790:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984821120 00000100:00100000:1.0:1787383223.457819:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787383223.457825:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:3648:x1874206984821120:12345-0@lo:400: 00000100:00100000:1.0:1787383223.457860:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+15:3648:x1874206984821120:12345-0@lo:400: Request processed in 34us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383223.457877:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787383223.457906:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984822144 00000100:00100000:1.0:1787383223.457910:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984822144 00000100:00100000:1.0:1787383223.457932:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984822656 00000100:00100000:1.0:1787383223.457935:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984822656 00000100:00100000:1.0:1787383223.457951:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787383223.457957:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984822144:12345-0@lo:400: 00000100:00100000:1.0:1787383223.457984:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984822144:12345-0@lo:400: Request processed in 27us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383223.457989:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787383223.457999:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787383223.458005:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984822656:12345-0@lo:400: 00000100:00100000:1.0:1787383223.458025:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984822656:12345-0@lo:400: Request processed in 21us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383223.458030:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787383223.458064:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984821632 00000100:00100000:1.0:1787383223.458067:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984821632 00000100:00100000:1.0:1787383223.458085:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787383223.458090:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984821632:12345-0@lo:400: 00000100:00100000:1.0:1787383223.458121:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984821632:12345-0@lo:400: Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383223.458127:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787383223.458166:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984821120:0@lo:400: 00000100:00100000:1.0:1787383223.458177:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984821632:0@lo:400: 00010000:00080000:1.0:1787383223.458187:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2ed80 x1874206984822144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383223.458207:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984822144:0@lo:400: 00010000:00080000:1.0:1787383223.458217:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2ea00 x1874206984822656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383223.458223:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787383223.458237:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984822656:0@lo:400: 00000100:00080000:1.0:1787383223.458273:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383223.458277:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383223.458281:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383223.458283:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383223.469067:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383223.469289:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984821376:0@lo:400: 00010000:00080000:2.0:1787383223.469309:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2dc00 x1874206984821888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383223.469319:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984821888:0@lo:400: 00010000:00080000:2.0:1787383223.469331:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2c700 x1874206984822400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383223.469359:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984822400:0@lo:400: 00000100:00100000:2.0:1787383223.469392:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984821248:0@lo:400: 00000100:00100000:2.0:1787383223.469415:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984821760:0@lo:400: 00000100:00100000:1.0:1787383223.469605:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383223.472030:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984822016:0@lo:400: 00000100:00100000:1.0:1787383223.472098:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383223.473021:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984822528:0@lo:400: 00000100:00100000:1.0:1787383223.473058:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383223.474581:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984822272 00000100:00100000:3.0:1787383223.474617:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984822272 00000100:00100000:3.0:1787383223.474696:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984821504 00000100:00100000:3.0:1787383223.474700:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984821504 00000100:00100000:3.0:1787383223.474724:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787383223.474734:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984822272:12345-0@lo:400: 00000100:00100000:3.0:1787383223.474816:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984822272:12345-0@lo:400: Request processed in 83us (5826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383223.474823:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787383223.474838:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787383223.474844:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984821504:12345-0@lo:400: 00000100:00100000:2.0:1787383223.474910:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984822016 00000100:00100000:2.0:1787383223.474916:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984822016 00000100:00100000:2.0:1787383223.474946:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984822528 00000100:00100000:2.0:1787383223.474949:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984822528 00000100:00100000:2.0:1787383223.474969:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787383223.474976:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984822016:12345-0@lo:400: 00000100:00100000:2.0:1787383223.475017:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984822016:12345-0@lo:400: Request processed in 41us (2919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383223.475022:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787383223.475035:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787383223.475041:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984822528:12345-0@lo:400: 00000100:00100000:2.0:1787383223.475068:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984822528:12345-0@lo:400: Request processed in 27us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383223.475074:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787383223.475118:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984822272:0@lo:400: 00010000:00080000:2.0:1787383223.475149:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2ca80 x1874206984822016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383223.475160:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984822016:0@lo:400: 00010000:00080000:2.0:1787383223.475170:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2d880 x1874206984822528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383223.475178:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984822528:0@lo:400: 00000100:00080000:2.0:1787383223.475225:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383223.475229:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383223.475232:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383223.476793:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984821504:12345-0@lo:400: Request processed in 1942us (7181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383223.476805:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787383223.484394:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984821504:0@lo:400: 00000100:00100000:3.0:1787383223.865065:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383223.865122:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383223.865162:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383223.865196:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383223.865218:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383223.865305:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965896064 00000100:00100000:2.0:1787383223.865315:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965896064 00000100:00100000:2.0:1787383223.865370:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 198 00000100:00100000:2.0:1787383223.865380:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+8:2403:x1874206965896064:12345-192.168.203.2@tcp:400: 00000100:00100000:2.0:1787383223.865445:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+8:2403:x1874206965896064:12345-192.168.203.2@tcp:400: Request processed in 66us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383223.865452:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 198 00000100:00100000:2.0:1787383223.865484:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965896448 00000100:00100000:2.0:1787383223.865488:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965896448 00000100:00100000:2.0:1787383223.865520:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965896576 00000100:00100000:2.0:1787383223.865523:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965896576 00000100:00100000:2.0:1787383223.865542:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:2.0:1787383223.865548:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965896448:12345-192.168.203.2@tcp:400: 00000100:00100000:2.0:1787383223.865578:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965896448:12345-192.168.203.2@tcp:400: Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383223.865585:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:2.0:1787383223.865596:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:2.0:1787383223.865602:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965896576:12345-192.168.203.2@tcp:400: 00000100:00100000:2.0:1787383223.865624:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965896576:12345-192.168.203.2@tcp:400: Request processed in 22us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383223.865630:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00080000:2.0:1787383223.865657:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383223.865674:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383223.866371:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965896192 00000100:00100000:1.0:1787383223.866377:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965896192 00000100:00100000:1.0:1787383223.866426:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965896320 00000100:00100000:1.0:1787383223.866431:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965896320 00000100:00100000:1.0:1787383223.866454:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:1.0:1787383223.866462:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965896192:12345-192.168.203.2@tcp:400: 00000100:00100000:1.0:1787383223.866504:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965896192:12345-192.168.203.2@tcp:400: Request processed in 43us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383223.866511:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:1.0:1787383223.866525:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:1.0:1787383223.866531:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965896320:12345-192.168.203.2@tcp:400: 00000100:00100000:1.0:1787383223.866567:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965896320:12345-192.168.203.2@tcp:400: Request processed in 36us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383223.866573:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00080000:2.0:1787383223.866763:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383223.866794:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383223.963179:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984822784:0@lo:13: 00000100:00100000:0.0:1787383223.963250:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383223.963326:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383223.963333:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984822912:0@lo:13: 00000100:00100000:0.0:1787383223.963356:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383223.963468:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984822784 00000100:00100000:1.0:1787383223.963476:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984822784 00000100:00100000:1.0:1787383223.963537:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984822912 00000100:00100000:1.0:1787383223.963540:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984822912 00000100:00100000:1.0:1787383223.963554:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787383223.963562:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984822784:12345-0@lo:13: 00002000:00000024:1.0:1787383223.963591:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383223.963652:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984822784:12345-0@lo:13: Request processed in 90us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383223.963659:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787383223.963678:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787383223.963683:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984822912:12345-0@lo:13: 00002000:00000024:1.0:1787383223.963694:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383223.963717:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984822912:12345-0@lo:13: Request processed in 34us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383223.963722:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787383223.963738:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1787383223.963815:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3ca80 x1874206984822912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383223.963839:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984822912:0@lo:13: 00010000:00080000:0.0:1787383223.963852:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d42300 x1874206984822784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383223.963886:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984822784:0@lo:13: 10000000:01000000:0.0:1787383224.090902:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787383224.090910:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96350233b000 from 48 10000000:01000000:0.0:1787383224.090915:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787383224.090974:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.090993:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.091159:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383224.091187:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984823040:0@lo:101: 00000100:00100000:0.0:1787383224.091254:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383224.091330:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963603918000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383224.091554:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984823040 00000100:00100000:1.0:1787383224.091562:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984823040 00000100:00100000:1.0:1787383224.091609:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787383224.091618:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+15:6517:x1874206984823040:12345-0@lo:101: 00010000:00010000:1.0:1787383224.091631:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383224.091654:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c1800/0xc40acec91532e4c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e4be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.091699:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c1800/0xc40acec91532e4c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e4be expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.091708:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c1800/0xc40acec91532e4c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e4be expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.091716:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1800, rc 0) 00000100:00100000:1.0:1787383224.091788:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984823040:12345-0@lo:101: Request processed in 147us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383224.091795:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787383224.092163:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984823040:0@lo:101: 00010000:00010000:0.0:1787383224.092178:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.092187:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383224.092248:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984823168:0@lo:501: 00000100:00100000:0.0:1787383224.092276:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383224.092305:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963603918000 going to sleep for 11 seconds 00000100:00100000:3.0:1787383224.092425:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984823168 00000100:00100000:3.0:1787383224.092430:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984823168 00000100:00100000:3.0:1787383224.092463:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787383224.092470:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984823168:12345-0@lo:501: 00000100:00100000:3.0:1787383224.092601:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984823168:12345-0@lo:501: Request processed in 131us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383224.092608:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787383224.092835:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984823168:0@lo:501: 00000100:00100000:0.0:1787383224.092872:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984823296:0@lo:503: 00000100:00100000:0.0:1787383224.092909:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383224.092934:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963603918000 going to sleep for 11 seconds 00000100:00100000:2.0:1787383224.092995:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984823296 00000100:00100000:2.0:1787383224.093214:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984823296 00000100:00100000:2.0:1787383224.093250:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787383224.093257:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984823296:12345-0@lo:503: 00000100:00100000:2.0:1787383224.093350:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984823296:12345-0@lo:503: Request processed in 93us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.093357:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787383224.093500:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984823296:0@lo:503: 00000100:00100000:0.0:1787383224.094677:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10350:1874206984823424:0@lo:502: 00000100:00100000:0.0:1787383224.094735:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383224.094851:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff963603918840 going to sleep for 11 seconds 00000100:00100000:1.0:1787383224.095915:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984823424 00000100:00100000:1.0:1787383224.095925:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984823424 00000100:00100000:1.0:1787383224.095986:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787383224.095996:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:10350:x1874206984823424:12345-0@lo:502: 00000100:00100000:1.0:1787383224.096161:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+16:10350:x1874206984823424:12345-0@lo:502: Request processed in 166us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383224.096168:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787383224.096231:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10350:1874206984823424:0@lo:502: 00000100:00100000:0.0:1787383224.096285:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10350:1874206984823552:0@lo:502: 00000100:00100000:0.0:1787383224.096324:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383224.096358:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffff963603918840 going to sleep for 11 seconds 00000100:00100000:3.0:1787383224.096538:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984823552 00000100:00100000:3.0:1787383224.096543:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984823552 00000100:00100000:3.0:1787383224.096573:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787383224.096586:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:10350:x1874206984823552:12345-0@lo:502: 00000100:00100000:3.0:1787383224.096673:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:10350:x1874206984823552:12345-0@lo:502: Request processed in 87us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383224.096679:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787383224.096809:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10350:1874206984823552:0@lo:502: 00000040:00080000:0.0:1787383224.096829:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787383224.097094:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787383224.097116:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787383224.097126:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.097136:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383224.097145:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787383224.097147:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787383224.097150:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787383224.097175:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.097183:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.097192:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383224.097205:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984823680:0@lo:101: 00000100:00100000:3.0:1787383224.097232:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.097264:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383224.097606:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984823680 00000100:00100000:2.0:1787383224.097613:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984823680 00000100:00100000:2.0:1787383224.097846:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787383224.097854:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+16:6517:x1874206984823680:12345-0@lo:101: 00010000:00010000:2.0:1787383224.097865:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383224.097876:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b6000/0xc40acec91532e4d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e4cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.097897:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b6000/0xc40acec91532e4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e4cc expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.097907:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b6000/0xc40acec91532e4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e4cc expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.097915:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b6000, rc 0) 00000100:00100000:2.0:1787383224.097958:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984823680:12345-0@lo:101: Request processed in 105us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.097964:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787383224.098898:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984823680:0@lo:101: 00010000:00010000:3.0:1787383224.098921:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.098946:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383224.099029:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984823808:0@lo:501: 00000100:00100000:3.0:1787383224.099069:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.100675:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383224.101373:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984823808 00000100:00100000:0.0:1787383224.101382:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984823808 00000100:00100000:0.0:1787383224.101536:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787383224.101546:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984823808:12345-0@lo:501: 00000100:00100000:0.0:1787383224.101713:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984823808:12345-0@lo:501: Request processed in 168us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383224.101720:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787383224.101822:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984823808:0@lo:501: 00000100:00100000:3.0:1787383224.101867:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984823936:0@lo:503: 00000100:00100000:3.0:1787383224.101921:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.102419:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383224.102614:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984823936 00000100:00100000:1.0:1787383224.102620:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984823936 00000100:00100000:1.0:1787383224.102659:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787383224.102666:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984823936:12345-0@lo:503: 00000100:00100000:1.0:1787383224.102762:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984823936:12345-0@lo:503: Request processed in 96us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383224.102787:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787383224.102867:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984823936:0@lo:503: 00000100:00100000:3.0:1787383224.103301:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10351:1874206984824064:0@lo:502: 00000100:00100000:3.0:1787383224.103344:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.103373:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787383224.103479:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984824064 00000100:00100000:1.0:1787383224.103484:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984824064 00000100:00100000:1.0:1787383224.103518:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787383224.103622:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:10351:x1874206984824064:12345-0@lo:502: 00000100:00100000:1.0:1787383224.103721:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+17:10351:x1874206984824064:12345-0@lo:502: Request processed in 100us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383224.103844:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10351:1874206984824064:0@lo:502: 00000020:01000000:3.0:1787383224.103869:0:10351:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383224.103878:0:10351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383224.103880:0:10351:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787383224.103885:0:10351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787383224.103907:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10351:1874206984824192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383224.103939:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.103961:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383224.104016:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984824192 00000100:00100000:2.0:1787383224.104026:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984824192 00000100:00100000:1.0:1787383224.104217:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787383224.104312:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787383224.104320:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:10351:x1874206984824192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383224.104406:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+17:10351:x1874206984824192:12345-0@lo:502:llog_process_th.0 Request processed in 87us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.104422:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787383224.104484:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10351:1874206984824192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383224.104505:0:10351:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383224.104510:0:10351:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383224.104511:0:10351:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787383224.104517:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1787383224.104581:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787383224.104609:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787383224.104619:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.104630:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383224.104649:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787383224.104652:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96363d95c800 from 48 10000000:01000000:1.0:1787383224.104655:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787383224.104679:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.104687:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.104695:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383224.104710:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984824320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.104743:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383224.111670:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5780 going to sleep for 11 seconds 00000100:00100000:0.0:1787383224.111930:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984824320 00000100:00100000:0.0:1787383224.111939:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984824320 00000100:00100000:0.0:1787383224.112204:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787383224.112214:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+17:6517:x1874206984824320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383224.112229:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383224.112260:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96363dac9c00/0xc40acec91532e4e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e4da expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.112285:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac9c00/0xc40acec91532e4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e4da expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.112295:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96363dac9c00/0xc40acec91532e4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e4da expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.112304:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9c00, rc 0) 00000100:00100000:0.0:1787383224.112359:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984824320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (7615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383224.112365:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787383224.112619:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984824320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383224.112635:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.112659:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383224.112730:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984824448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.112762:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383224.112812:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5780 going to sleep for 11 seconds 00000100:00100000:3.0:1787383224.112888:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984824448 00000100:00100000:3.0:1787383224.112893:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984824448 00000100:00100000:3.0:1787383224.112970:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787383224.112984:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984824448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.113106:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984824448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383224.113112:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787383224.113177:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984824448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383224.113206:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984824576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383224.113246:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383224.115302:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383224.115318:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984824576 00000100:00100000:1.0:1787383224.115328:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984824576 00000100:00100000:1.0:1787383224.115513:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787383224.115523:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984824576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.115708:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984824576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (2460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383224.115716:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787383224.115988:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984824576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.116994:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10352:1874206984824704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383224.117214:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383224.117316:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383224.117410:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984824704 00000100:00100000:2.0:1787383224.117417:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984824704 00000100:00100000:2.0:1787383224.117461:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787383224.117469:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:10352:x1874206984824704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383224.117885:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+18:10352:x1874206984824704:12345-0@lo:502:llog_process_th.0 Request processed in 416us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.117894:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787383224.117968:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10352:1874206984824704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383224.118015:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10352:1874206984824832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383224.118062:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383224.118106:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383224.121103:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984824832 00000100:00100000:3.0:1787383224.121118:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984824832 00000100:00100000:3.0:1787383224.121179:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787383224.121188:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+18:10352:x1874206984824832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383224.122722:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+18:10352:x1874206984824832:12345-0@lo:502:llog_process_th.0 Request processed in 1528us (4652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383224.122735:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787383224.123583:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10352:1874206984824832:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787383224.123626:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787383224.124133:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787383224.124154:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787383224.135602:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.135616:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383224.135626:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787383224.135629:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787383224.135631:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787383224.135696:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.135711:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.135723:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383224.136299:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984824960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.136373:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.136473:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383224.136623:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984824960 00000100:00100000:2.0:1787383224.136630:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984824960 00000100:00100000:2.0:1787383224.137264:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787383224.137277:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+18:6517:x1874206984824960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383224.137292:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383224.137308:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b6c00/0xc40acec91532e4ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e4e8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.137354:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b6c00/0xc40acec91532e4ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e4e8 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.137365:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b6c00/0xc40acec91532e4ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e4e8 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.137374:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b6c00, rc 0) 00000100:00100000:2.0:1787383224.137489:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984824960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.137496:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787383224.139331:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984824960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383224.139360:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.139372:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383224.139502:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984825088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383224.139555:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383224.139594:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383224.140235:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984825088 00000100:00100000:3.0:1787383224.140244:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984825088 00000100:00100000:3.0:1787383224.140295:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787383224.140304:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984825088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.140558:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984825088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383224.140566:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787383224.140645:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984825088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383224.140687:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984825216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383224.140740:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383224.140958:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383224.141089:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984825216 00000100:00100000:3.0:1787383224.141093:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984825216 00000100:00100000:3.0:1787383224.141127:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787383224.141133:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984825216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.141329:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984825216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383224.141336:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787383224.141398:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984825216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383224.141917:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10353:1874206984825344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383224.142031:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383224.142095:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffff963603918900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383224.142125:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984825344 00000100:00100000:3.0:1787383224.142136:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984825344 00000100:00100000:3.0:1787383224.142260:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787383224.142268:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+19:10353:x1874206984825344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383224.142393:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+19:10353:x1874206984825344:12345-0@lo:502:llog_process_th.0 Request processed in 124us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383224.142400:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787383224.142476:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10353:1874206984825344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383224.142508:0:10353:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383224.142517:0:10353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383224.142519:0:10353:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787383224.142524:0:10353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787383224.142545:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10353:1874206984825472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383224.142578:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383224.142628:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffff963603918900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383224.142878:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984825472 00000100:00100000:3.0:1787383224.142883:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984825472 00000100:00100000:3.0:1787383224.142944:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787383224.142952:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+19:10353:x1874206984825472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383224.143032:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+19:10353:x1874206984825472:12345-0@lo:502:llog_process_th.0 Request processed in 80us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383224.143039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787383224.143262:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10353:1874206984825472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383224.143282:0:10353:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383224.143288:0:10353:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383224.143290:0:10353:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787383224.143300:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1787383224.143450:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787383224.143473:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787383224.143495:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.143506:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383224.143516:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787383224.143518:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9636183cf000 from 48 10000000:01000000:1.0:1787383224.143521:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787383224.143546:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.143554:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.143562:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383224.143578:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984825600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.143609:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383224.143646:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383224.143922:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984825600 00000100:00100000:0.0:1787383224.143927:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984825600 00000100:00100000:0.0:1787383224.143952:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787383224.143959:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+19:6517:x1874206984825600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383224.143978:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383224.143991:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96363dac9a00/0xc40acec91532e4fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e4f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.144013:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac9a00/0xc40acec91532e4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e4f6 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.144024:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96363dac9a00/0xc40acec91532e4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e4f6 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.144032:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9a00, rc 0) 00000100:00100000:0.0:1787383224.144074:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984825600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383224.144080:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787383224.144255:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984825600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383224.144268:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.144289:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383224.144346:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984825728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.144372:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383224.144397:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383224.144437:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984825728 00000100:00100000:0.0:1787383224.144441:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984825728 00000100:00100000:0.0:1787383224.144460:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787383224.144466:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984825728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383224.144620:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984825728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383224.144627:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787383224.145062:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984825728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.145089:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984825856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.145127:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383224.145249:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383224.145280:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984825856 00000100:00100000:0.0:1787383224.145284:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984825856 00000100:00100000:0.0:1787383224.145350:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787383224.145364:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984825856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383224.145452:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984825856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383224.145458:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787383224.145519:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984825856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.146285:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10354:1874206984825984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383224.146326:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383224.146388:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787383224.146421:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984825984 00000100:00100000:2.0:1787383224.146425:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984825984 00000100:00100000:2.0:1787383224.146495:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787383224.146502:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:10354:x1874206984825984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383224.146598:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:10354:x1874206984825984:12345-0@lo:502:llog_process_th.0 Request processed in 96us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.146614:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787383224.146681:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10354:1874206984825984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383224.146725:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10354:1874206984826112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383224.146758:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383224.146986:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787383224.147089:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984826112 00000100:00100000:3.0:1787383224.147093:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984826112 00000100:00100000:3.0:1787383224.147116:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787383224.147122:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+20:10354:x1874206984826112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383224.147208:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+20:10354:x1874206984826112:12345-0@lo:502:llog_process_th.0 Request processed in 86us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383224.147214:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787383224.147335:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10354:1874206984826112:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787383224.147354:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787383224.147509:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787383224.147527:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787383224.147536:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.147546:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383224.147567:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1787383224.147569:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1787383224.147571:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787383224.147596:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.147604:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.147613:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383224.147627:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984826240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.147663:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.147720:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363530dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383224.147891:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984826240 00000100:00100000:2.0:1787383224.147896:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984826240 00000100:00100000:0.0:1787383224.147976:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787383224.147985:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984826240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383224.147994:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383224.148005:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96363dac9000/0xc40acec91532e50b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e504 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.148025:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac9000/0xc40acec91532e50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e504 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.148034:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96363dac9000/0xc40acec91532e50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e504 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.148042:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9000, rc 0) 00000100:00100000:0.0:1787383224.148069:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984826240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383224.148075:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787383224.148522:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984826240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383224.148536:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.148545:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383224.148596:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984826368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.148623:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.148660:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363530dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383224.149069:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984826368 00000100:00100000:1.0:1787383224.149074:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984826368 00000100:00100000:1.0:1787383224.149098:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787383224.149117:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96361a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984826368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.149259:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96361a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984826368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383224.149266:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787383224.149399:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984826368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.149433:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984826496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.149479:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.149505:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363530dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383224.149596:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984826496 00000100:00100000:1.0:1787383224.149600:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984826496 00000100:00100000:1.0:1787383224.149618:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787383224.149623:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984826496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.149815:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984826496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.149905:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984826496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 281us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383224.149912:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787383224.150564:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10355:1874206984826624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383224.150604:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383224.150631:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787383224.150723:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984826624 00000100:00100000:2.0:1787383224.150728:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984826624 00000100:00100000:2.0:1787383224.150761:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787383224.150795:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:10355:x1874206984826624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383224.150890:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:10355:x1874206984826624:12345-0@lo:502:llog_process_th.0 Request processed in 97us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.150897:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787383224.151092:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10355:1874206984826624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383224.151115:0:10355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383224.151123:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383224.151125:0:10355:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787383224.151142:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787383224.151356:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10355:1874206984826752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383224.151392:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383224.151410:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5000 going to sleep for 11 seconds 00000100:00100000:2.0:1787383224.151455:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984826752 00000100:00100000:2.0:1787383224.151459:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984826752 00000100:00100000:2.0:1787383224.151520:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787383224.151527:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:10355:x1874206984826752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383224.151608:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:10355:x1874206984826752:12345-0@lo:502:llog_process_th.0 Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.151615:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787383224.151899:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10355:1874206984826752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383224.151919:0:10355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383224.151925:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383224.151927:0:10355:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787383224.151939:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1787383224.152240:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1787383224.152261:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787383224.152271:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.152282:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383224.152291:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787383224.152294:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9636064d1800 from 48 10000000:01000000:2.0:1787383224.152302:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787383224.152326:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.152334:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.152343:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383224.152359:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984826880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383224.152392:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383224.152424:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6840 going to sleep for 11 seconds 00000100:00100000:0.0:1787383224.152476:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984826880 00000100:00100000:0.0:1787383224.152481:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984826880 00000100:00100000:0.0:1787383224.152515:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787383224.152523:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984826880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383224.152532:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383224.152543:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96363dac9e00/0xc40acec91532e519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e512 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.152587:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac9e00/0xc40acec91532e519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e512 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.152597:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96363dac9e00/0xc40acec91532e519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e512 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383224.152604:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9e00, rc 0) 00000100:00100000:0.0:1787383224.152634:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984826880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383224.152650:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787383224.152811:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984826880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383224.152823:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.152831:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383224.152881:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984827008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383224.152905:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383224.152926:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383224.152938:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984827008 00000100:00100000:2.0:1787383224.152942:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984827008 00000100:00100000:2.0:1787383224.152959:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787383224.153036:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984827008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383224.153148:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984827008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.153236:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787383224.153331:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984827008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.153360:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984827136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.153399:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383224.153410:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5000 going to sleep for 11 seconds 00000100:00100000:0.0:1787383224.153471:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984827136 00000100:00100000:0.0:1787383224.153476:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984827136 00000100:00100000:0.0:1787383224.153495:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787383224.153502:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984827136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383224.153581:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984827136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383224.153588:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787383224.153729:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984827136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.154441:0:10356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10356:1874206984827264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383224.154476:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.154698:0:10356:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363530d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383224.154742:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984827264 00000100:00100000:0.0:1787383224.154748:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984827264 00000100:00100000:2.0:1787383224.155043:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787383224.155053:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:10356:x1874206984827264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383224.155340:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:10356:x1874206984827264:12345-0@lo:502:llog_process_th.0 Request processed in 289us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.155347:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787383224.155425:0:10356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10356:1874206984827264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383224.155467:0:10356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10356:1874206984827392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383224.155613:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.155672:0:10356:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610d619c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383224.155706:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984827392 00000100:00100000:1.0:1787383224.155710:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984827392 00000100:00100000:1.0:1787383224.155741:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787383224.155747:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:10356:x1874206984827392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383224.156463:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:10356:x1874206984827392:12345-0@lo:502:llog_process_th.0 Request processed in 713us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383224.156472:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787383224.156729:0:10356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10356:1874206984827392:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787383224.156759:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787383224.157303:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787383224.157323:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787383224.157333:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.157343:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383224.157351:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787383224.157353:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1787383224.157355:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787383224.157382:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.157389:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383224.157408:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383224.157424:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984827520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.157460:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383224.157525:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383224.157650:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984827520 00000100:00100000:2.0:1787383224.157656:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984827520 00000100:00100000:2.0:1787383224.157728:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787383224.157735:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984827520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383224.157744:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383224.157755:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b7c00/0xc40acec91532e527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e520 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.157802:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b7c00/0xc40acec91532e527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e520 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.157811:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b7c00/0xc40acec91532e527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e520 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.157818:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b7c00, rc 0) 00000100:00100000:2.0:1787383224.157860:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984827520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.157866:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787383224.157932:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984827520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383224.157944:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.157951:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383224.158008:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984827648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.158033:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.158356:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363530d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383224.158415:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984827648 00000100:00100000:1.0:1787383224.158419:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984827648 00000100:00100000:1.0:1787383224.158439:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787383224.158444:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984827648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.158706:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984827648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383224.158714:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787383224.158847:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984827648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.158874:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984827776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.158924:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.158947:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363530d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383224.159040:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984827776 00000100:00100000:1.0:1787383224.159045:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984827776 00000100:00100000:1.0:1787383224.159074:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787383224.159081:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984827776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383224.159174:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984827776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383224.159180:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787383224.159399:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984827776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.160272:0:10357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10357:1874206984827904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383224.160328:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.160391:0:10357:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363530d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383224.160429:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984827904 00000100:00100000:1.0:1787383224.160435:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984827904 00000100:00100000:1.0:1787383224.160562:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787383224.160572:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:10357:x1874206984827904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383224.160686:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:10357:x1874206984827904:12345-0@lo:502:llog_process_th.0 Request processed in 115us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383224.160699:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787383224.160804:0:10357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10357:1874206984827904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383224.160830:0:10357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383224.160839:0:10357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383224.160841:0:10357:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787383224.160847:0:10357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787383224.160868:0:10357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10357:1874206984828032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383224.160900:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383224.161383:0:10357:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636050c30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383224.161448:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984828032 00000100:00100000:2.0:1787383224.161453:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984828032 00000100:00100000:2.0:1787383224.161545:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787383224.161568:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+23:10357:x1874206984828032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383224.161684:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+23:10357:x1874206984828032:12345-0@lo:502:llog_process_th.0 Request processed in 118us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.161691:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787383224.161912:0:10357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10357:1874206984828032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383224.161936:0:10357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383224.161942:0:10357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383224.161944:0:10357:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787383224.161948:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787383224.162162:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1787383224.162181:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787383224.162191:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.162201:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383224.162210:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787383224.162212:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9636345a8000 from 1 10000000:01000000:2.0:1787383224.162215:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787383224.162241:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b6e00/0xc40acec91532e52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.162248:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636102b6e00/0xc40acec91532e52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.162255:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636102b6e00/0xc40acec91532e52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383224.162270:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984828160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383224.162301:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383224.162328:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360530f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383224.162536:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984828160 00000100:00100000:3.0:1787383224.162542:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984828160 00000100:00100000:3.0:1787383224.162572:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787383224.162579:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984828160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383224.162588:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383224.162600:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636013fdc00/0xc40acec91532e535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e52e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.162634:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636013fdc00/0xc40acec91532e535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e52e expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.162654:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636013fdc00/0xc40acec91532e535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e52e expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383224.162662:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636013fdc00, rc 0) 00000100:00100000:3.0:1787383224.162701:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984828160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383224.162707:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787383224.162890:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984828160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383224.162912:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636102b6e00/0xc40acec91532e52e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e535 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.162920:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636102b6e00/0xc40acec91532e52e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e535 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383224.162981:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984828288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383224.163007:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383224.163019:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360530f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383224.163108:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984828288 00000100:00100000:3.0:1787383224.163112:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984828288 00000100:00100000:3.0:1787383224.163128:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787383224.163247:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984828288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383224.163319:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984828288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (311us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787383224.163327:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787383224.163723:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984828288:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787383224.163747:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787383224.163754:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b6e00/0xc40acec91532e52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e535 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383224.163761:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636102b6e00/0xc40acec91532e52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e535 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383224.476996:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383224.477019:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984828416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383224.477086:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383224.477157:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984828416 00000100:00100000:0.0:1787383224.477165:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984828416 00000100:00100000:0.0:1787383224.477228:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787383224.477237:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984828416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383224.477270:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787383224.477324:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984828416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383224.477329:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787383224.477416:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984828416:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787383224.986981:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383224.987865:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984828544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383224.987931:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383224.988084:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984828672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383224.988115:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383224.988140:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984828544 00000100:00100000:2.0:1787383224.988147:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984828544 00000100:00100000:2.0:1787383224.988184:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984828672 00000100:00100000:2.0:1787383224.988188:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984828672 00000100:00100000:2.0:1787383224.988203:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787383224.988212:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984828544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787383224.988266:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383224.988333:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984828544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.988341:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787383224.988357:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787383224.988364:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984828672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383224.988373:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383224.988403:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984828672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383224.988408:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787383224.988417:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f995180 x1874206984828544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787383224.988429:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f991f80 x1874206984828672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383224.988435:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984828544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383224.988439:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984828672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383225.141478:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383225.141681:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965896704 00000100:00100000:3.0:1787383225.141691:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965896704 00000100:00100000:3.0:1787383225.141762:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 241 00000100:00100000:3.0:1787383225.141801:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+8:6173:x1874206965896704:12345-192.168.203.2@tcp:101: 00010000:00010000:3.0:1787383225.141818:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383225.141836:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636013fce00/0xc40acec91532e53c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34025f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383225.141864:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636013fce00/0xc40acec91532e53c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025f2 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383225.141891:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636013fce00/0xc40acec91532e53c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025f2 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383225.141900:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636013fce00, rc 0) 00000100:00100000:3.0:1787383225.141962:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6173:x1874206965896704:12345-192.168.203.2@tcp:101: Request processed in 164us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383225.141969:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 241 00000100:00100000:3.0:1787383225.144674:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383225.145079:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965896832 00000100:00100000:0.0:1787383225.145089:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965896832 00000100:00100000:0.0:1787383225.145145:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 242 00000100:00100000:0.0:1787383225.145155:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6173:x1874206965896832:12345-192.168.203.2@tcp:501: 00000100:00100000:0.0:1787383225.145511:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6173:x1874206965896832:12345-192.168.203.2@tcp:501: Request processed in 356us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383225.145519:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 242 00000100:00100000:0.0:1787383225.147974:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383225.152252:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965896960 00000100:00100000:3.0:1787383225.152269:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965896960 00000100:00100000:3.0:1787383225.152358:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 243 00000100:00100000:3.0:1787383225.152369:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6173:x1874206965896960:12345-192.168.203.2@tcp:503: 00000100:00100000:3.0:1787383225.152535:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6173:x1874206965896960:12345-192.168.203.2@tcp:503: Request processed in 167us (4568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383225.152543:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 243 00000100:00100000:3.0:1787383225.155725:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383225.156390:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965897088 00000100:00100000:0.0:1787383225.156405:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965897088 00000100:00100000:0.0:1787383225.156475:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 244 00000100:00100000:0.0:1787383225.156486:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6661:x1874206965897088:12345-192.168.203.2@tcp:502: 00000100:00100000:0.0:1787383225.156674:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6661:x1874206965897088:12345-192.168.203.2@tcp:502: Request processed in 188us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383225.156682:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 244 00000100:00100000:0.0:1787383225.160639:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383225.162627:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965897216 00000100:00100000:1.0:1787383225.162661:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965897216 00000100:00100000:1.0:1787383225.162859:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 245 00000100:00100000:1.0:1787383225.162871:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6661:x1874206965897216:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383225.163153:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6661:x1874206965897216:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 283us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383225.163162:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 245 00000100:00100000:1.0:1787383225.178621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383225.181709:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965897344 00000100:00100000:3.0:1787383225.181734:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965897344 00000100:00100000:2.0:1787383225.183335:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 246 00000100:00100000:2.0:1787383225.183357:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6173:x1874206965897344:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383225.183382:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383225.183408:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b6200/0xc40acec91532e543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34025f9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383225.183448:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b6200/0xc40acec91532e543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025f9 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383225.183461:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b6200/0xc40acec91532e543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025f9 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383225.183472:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b6200, rc 0) 00000100:00100000:2.0:1787383225.185357:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6173:x1874206965897344:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 1994us (6744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383225.185397:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 246 00000100:00100000:3.0:1787383225.195211:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383225.195857:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965897472 00000100:00100000:1.0:1787383225.195872:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965897472 00000100:00100000:1.0:1787383225.195997:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 247 00000100:00100000:1.0:1787383225.196011:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6173:x1874206965897472:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383225.196173:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6173:x1874206965897472:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 165us (974us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787383225.196182:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 247 00010000:00010000:2.0:1787383226.012471:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787383226.757337:0:10394:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd5753a2f0 00000020:00000080:0.0:1787383226.757352:0:10394:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787383226.757357:0:10394:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787383226.757364:0:10394:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5753c580 20000000:00000080:0.0:1787383226.757376:0:10394:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96363da92800 uarg=0000000000000000 20000000:01000000:0.0:1787383226.757429:0:10394:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787383226.757435:0:10394:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787383226.757440:0:10394:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787383226.758042:0:10395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787383226.758199:0:10394:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787383226.762744:0:10394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787383226.762822:0:10394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787383226.762837:0:10394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787383226.762856:0:10394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787383226.762886:0:10394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.762911:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c8400/0xc40acec91532e1e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e1df expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.762920:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c9200/0xc40acec91532e1f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e1ed expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.762927:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c9e00/0xc40acec91532e248 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e241 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.762933:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963601655400/0xc40acec91532e36e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e367 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.762943:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c8e00/0xc40acec91532e486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025ba expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.762951:0:10394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.763000:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c8e00/0xc40acec91532e486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025ba expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.763039:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636113c8e00/0xc40acec91532e486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025ba expref: 9 pid: 6515 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383226.763059:0:10394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1874206984828800:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383226.763201:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963601655400/0xc40acec91532e36e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e367 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.763209:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff963601655400/0xc40acec91532e36e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e367 expref: 23 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383226.763219:0:10394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1874206984828928:0@lo:104: 00000100:00100000:0.0:1787383226.763274:0:10394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383226.763338:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c9e00/0xc40acec91532e248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e241 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.763349:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636113c9e00/0xc40acec91532e248 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e241 expref: 23 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383226.763350:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984828928 00000100:00100000:1.0:1787383226.763367:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984828928 00000100:00100000:0.0:1787383226.763371:0:10394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1874206984829056:0@lo:104: 00000100:00100000:0.0:1787383226.763408:0:10394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383226.766296:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c9200/0xc40acec91532e1f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e1ed expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.766318:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636113c9200/0xc40acec91532e1f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e1ed expref: 23 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383226.766336:0:10394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1874206984829184:0@lo:104: 00010000:00010000:2.0:1787383226.766403:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c8400/0xc40acec91532e1e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e1df expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.766411:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636113c8400/0xc40acec91532e1e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e1df expref: 23 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383226.766420:0:10394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1874206984829312:0@lo:104: 00000100:00100000:2.0:1787383226.766441:0:10394:0:(client.c:2702:ptlrpc_set_wait()) set ffff963606513600 going to sleep for 11 seconds 00000100:00100000:1.0:1787383226.766737:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787383226.766830:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383226.766856:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383226.766868:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984829056 00000100:00100000:1.0:1787383226.766885:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984829056 00000100:00100000:1.0:1787383226.766933:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984829184 00000100:00100000:1.0:1787383226.766935:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984829184 00000100:00100000:1.0:1787383226.766944:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984829312 00000100:00100000:1.0:1787383226.766946:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984829312 00000100:00100000:1.0:1787383226.766961:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787383226.766971:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+6:10394:x1874206984828928:12345-0@lo:104: 00010000:00010000:1.0:1787383226.766985:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e36e expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383226.767302:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383226.767310:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+6:10394:x1874206984828928:12345-0@lo:104: Request processed in 341us (4036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383226.767319:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787383226.767344:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787383226.767350:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635024bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+5:10394:x1874206984829056:12345-0@lo:104: 00010000:00010000:1.0:1787383226.767359:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e248 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383226.767423:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:0.0:1787383226.767430:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787383226.767438:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1787383226.767920:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383226.767931:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e36e expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.767939:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9a00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383226.767953:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e36e expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.767963:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e36e expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383226.767970:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e36e expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383226.767976:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787383226.768025:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e36e expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.768032:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383226.768058:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e36e expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.768064:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c9a00/0xc40acec91532e367 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e36e expref: -99 pid: 9512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.768078:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383226.768079:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383226.768081:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383226.768291:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383226.768330:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984829440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383226.768371:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383226.768565:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965897600 00000100:00100000:0.0:1787383226.768573:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965897600 00010000:00010000:0.0:1787383226.768608:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c8e00/0xc40acec91532e486 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025ba expref: 10 pid: 6515 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383226.768653:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984829440 00000100:00100000:0.0:1787383226.768657:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984829440 00010000:00010000:0.0:1787383226.768671:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963601655400/0xc40acec91532e36e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e367 expref: 24 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383226.768706:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:0.0:1787383226.768714:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2402:x1874206965897600:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383226.768728:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383226.768734:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c8e00/0xc40acec91532e486 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025ba expref: 10 pid: 6515 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.768747:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c8e00/0xc40acec91532e486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025ba expref: 10 pid: 6515 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.768791:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383226.768840:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2402:x1874206965897600:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 126us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383226.768847:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:0.0:1787383226.768863:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787383226.768869:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984829440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383226.768879:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383226.768883:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963601655400/0xc40acec91532e36e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e367 expref: 24 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.768892:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963601655400/0xc40acec91532e36e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e367 expref: 24 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.768902:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383226.768932:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984829440:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383226.768938:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383226.769420:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984829440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383226.770238:0:10396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787383226.770251:0:10396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+5:10394:x1874206984829184:12345-0@lo:104: 00010000:00010000:3.0:1787383226.770275:0:10396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e1f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.770375:0:10396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787383226.770381:0:10396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+5:10394:x1874206984829184:12345-0@lo:104: Request processed in 134us (3552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383226.770389:0:10396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787383226.770411:0:10396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383226.770418:0:10396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+4:10394:x1874206984829312:12345-0@lo:104: 00010000:00010000:3.0:1787383226.770426:0:10396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532e1df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e1e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.770459:0:10396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787383226.770464:0:10396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+4:10394:x1874206984829312:12345-0@lo:104: Request processed in 47us (3608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383226.770469:0:10396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1787383226.770485:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383226.770492:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e1f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.770500:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8c00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383226.770504:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e1f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.770513:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e1f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383226.770520:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e1f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383226.770533:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383226.770944:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e1f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.770954:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383226.770983:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e1f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.770991:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532e1ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e1f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.771006:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383226.771009:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532e1df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e1e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.771016:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383226.771019:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532e1df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e1e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.771027:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532e1df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e1e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383226.771034:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532e1df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e1e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383226.771039:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383226.771054:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532e1df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e1e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.771061:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383226.771075:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532e1df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e1e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.771081:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532e1df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e1e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.771091:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383226.771093:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383226.771095:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383226.771122:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984829696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383226.771173:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383226.771215:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383226.771221:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984829568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383226.771247:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383226.771275:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984829696 00000100:00100000:3.0:1787383226.771282:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984829696 00010000:00010000:3.0:1787383226.771310:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c8400/0xc40acec91532e1e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e1df expref: 24 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383226.771334:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984829568 00000100:00100000:3.0:1787383226.771338:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984829568 00010000:00010000:3.0:1787383226.771348:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c9200/0xc40acec91532e1f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e1ed expref: 25 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383226.771363:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787383226.771369:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+25:3648:x1874206984829696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383226.771381:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383226.771385:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c8400/0xc40acec91532e1e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e1df expref: 25 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.771405:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c8400/0xc40acec91532e1e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e1df expref: 25 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.771427:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383226.771457:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+25:3648:x1874206984829696:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383226.771464:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787383226.771479:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787383226.771484:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984829568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383226.771492:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383226.771496:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c9200/0xc40acec91532e1f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e1ed expref: 24 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.771504:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c9200/0xc40acec91532e1f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e1ed expref: 24 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.771513:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383226.771533:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984829568:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383226.771539:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1787383226.771973:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383226.771982:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635024bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+3:10394:x1874206984829056:12345-0@lo:104: Request processed in 4632us (8573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383226.771991:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787383226.772105:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984829568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383226.772114:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984829696:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383226.772177:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383226.772185:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e248 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.772193:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383226.772196:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e248 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.772204:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e248 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383226.772211:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e248 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383226.772216:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787383226.772253:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e248 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.772259:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383226.772278:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e248 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.772284:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c0c00/0xc40acec91532e241 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e248 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383226.772300:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383226.772302:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383226.772303:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383226.772380:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c8e00/0xc40acec91532e486 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025ba expref: 9 pid: 6515 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383226.772391:0:10394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1874206984828800:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383226.772404:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383226.772432:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963601655400/0xc40acec91532e36e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e367 expref: 23 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383226.772442:0:10394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1874206984828928:0@lo:104: 00000100:00100000:2.0:1787383226.772452:0:10394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1874206984829056:0@lo:104: 00010000:00010000:2.0:1787383226.772477:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9200/0xc40acec91532e1f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e1ed expref: 22 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383226.772485:0:10394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1874206984829184:0@lo:104: 00010000:00010000:2.0:1787383226.772495:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c8400/0xc40acec91532e1e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e1df expref: 21 pid: 6512 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383226.772502:0:10394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1874206984829312:0@lo:104: 00010000:00010000:2.0:1787383226.772527:0:10394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383226.772594:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984829824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383226.772651:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383226.772839:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984829824 00000100:00100000:2.0:1787383226.772845:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984829824 00010000:00010000:2.0:1787383226.772873:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c9e00/0xc40acec91532e248 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e241 expref: 21 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383226.772900:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787383226.772907:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+21:3649:x1874206984829824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383226.772918:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383226.772922:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c9e00/0xc40acec91532e248 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e241 expref: 21 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.772932:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c9e00/0xc40acec91532e248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e241 expref: 21 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.772944:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9e00/0xc40acec91532e248 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e241 expref: 21 pid: 6515 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.772959:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.772980:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.772997:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.773004:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.773010:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.773017:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.773023:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383226.773028:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.773035:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.773049:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.773059:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383226.773097:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+20:3649:x1874206984829824:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383226.773105:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787383226.773134:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984829824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383226.773163:0:10394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.773171:0:10394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383226.773177:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac8000/0xc40acec91532e54a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383226.986874:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383226.987049:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965897728 00000100:00100000:3.0:1787383226.987059:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965897728 00000100:00100000:3.0:1787383226.987138:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 248 00000100:00100000:3.0:1787383226.987148:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:6173:x1874206965897728:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383226.987174:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383226.987194:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636013fd800/0xc40acec91532e551 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402600 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.987230:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636013fd800/0xc40acec91532e551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402600 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.987243:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636013fd800/0xc40acec91532e551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402600 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383226.987252:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636013fd800, rc 0) 00000100:00100000:3.0:1787383226.987305:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6173:x1874206965897728:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 158us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383226.987312:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 248 00000100:00100000:0.0:1787383226.993970:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383226.994074:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965897856 00000100:00100000:1.0:1787383226.994085:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965897856 00000100:00100000:1.0:1787383226.994146:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 249 00000100:00100000:1.0:1787383226.994157:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6173:x1874206965897856:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383226.994422:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6173:x1874206965897856:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 265us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383226.994444:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 249 00000100:00100000:3.0:1787383226.996977:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383226.997106:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965897984 00000100:00100000:2.0:1787383226.997124:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965897984 00000100:00100000:2.0:1787383226.997173:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 250 00000100:00100000:2.0:1787383226.997182:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6173:x1874206965897984:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383226.997441:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6173:x1874206965897984:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 259us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383226.997449:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 250 00000100:00100000:2.0:1787383227.002735:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383227.002844:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965898112 00000100:00100000:3.0:1787383227.002854:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965898112 00000100:00100000:3.0:1787383227.002909:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 251 00000100:00100000:3.0:1787383227.002917:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6702:x1874206965898112:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787383227.003550:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6702:x1874206965898112:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 631us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383227.003559:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 251 00000100:00100000:0.0:1787383227.007319:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383227.007430:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965898240 00000100:00100000:1.0:1787383227.007441:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965898240 00000100:00100000:1.0:1787383227.007522:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 252 00000100:00100000:1.0:1787383227.007532:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6702:x1874206965898240:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383227.007718:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:6702:x1874206965898240:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 187us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383227.007725:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 252 00010000:00010000:0.0:1787383227.035922:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383227.550405:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383227.550440:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984829952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383227.550532:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383227.550646:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984829952 00000100:00100000:0.0:1787383227.550656:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984829952 00000100:00100000:0.0:1787383227.550716:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787383227.550726:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984829952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383227.550799:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787383227.550850:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984829952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383227.550859:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787383227.550919:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984829952:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787383228.059922:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787383228.443245:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383228.443253:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96350233b000 from 4 10000000:01000000:3.0:1787383228.443258:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383228.443309:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383228.443333:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383228.443345:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383228.443371:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984830080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383228.443435:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.443481:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608cd6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383228.443616:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984830080 00000100:00100000:0.0:1787383228.443625:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984830080 00000100:00100000:0.0:1787383228.443881:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787383228.443891:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984830080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383228.443904:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383228.443917:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96363dac9600/0xc40acec91532e55f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e558 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383228.443940:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac9600/0xc40acec91532e55f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e558 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383228.443949:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96363dac9600/0xc40acec91532e55f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e558 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383228.443959:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9600, rc 0) 00000100:00100000:0.0:1787383228.444008:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984830080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383228.444022:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787383228.444112:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984830080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383228.444129:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e55f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383228.444140:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e55f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383228.444217:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984830208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383228.444244:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.444693:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608cd6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383228.444741:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984830208 00000100:00100000:2.0:1787383228.444747:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984830208 00000100:00100000:2.0:1787383228.444802:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787383228.444809:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984830208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.444946:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984830208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.444952:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787383228.445955:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984830208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383228.446271:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984830336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383228.446333:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.446366:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608cd6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383228.446825:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984830336 00000100:00100000:2.0:1787383228.446832:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984830336 00000100:00100000:2.0:1787383228.446883:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787383228.446900:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984830336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.447246:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984830336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 346us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.447254:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787383228.447318:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984830336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383228.447715:0:10465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10465:1874206984830464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383228.447794:0:10465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.447823:0:10465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635022e0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787383228.447996:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984830464 00000100:00100000:1.0:1787383228.448003:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984830464 00000100:00100000:1.0:1787383228.448040:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787383228.448049:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:10465:x1874206984830464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383228.448141:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:10465:x1874206984830464:12345-0@lo:502:llog_process_th.0 Request processed in 91us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383228.448148:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787383228.448399:0:10465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10465:1874206984830464:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383228.448426:0:10465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383228.448437:0:10465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383228.448439:0:10465:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787383228.448445:0:10465:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96350233b000 00000020:00000080:3.0:1787383228.448448:0:10465:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787383228.448521:0:10465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10465:1874206984830592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383228.448558:0:10465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.448576:0:10465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635022e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787383228.448793:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984830592 00000100:00100000:2.0:1787383228.448798:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984830592 00000100:00100000:2.0:1787383228.448826:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787383228.448833:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:10465:x1874206984830592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383228.448919:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:10465:x1874206984830592:12345-0@lo:502:llog_process_th.0 Request processed in 86us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.448926:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787383228.449071:0:10465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10465:1874206984830592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383228.449093:0:10465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383228.449100:0:10465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383228.449102:0:10465:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787383228.449105:0:10465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787383228.449228:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787383228.449254:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383228.449264:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e55f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.449276:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e55f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383228.449286:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787383228.449288:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96363d95c800 from 4 10000000:01000000:2.0:1787383228.449291:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787383228.449317:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.449325:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.449333:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383228.449357:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984830720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.449387:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.449420:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383228.449551:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984830720 00000100:00100000:3.0:1787383228.449556:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984830720 00000100:00100000:3.0:1787383228.449592:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787383228.449601:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984830720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383228.449620:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383228.449632:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963601654600/0xc40acec91532e56d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e566 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383228.449654:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963601654600/0xc40acec91532e56d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e566 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383228.449663:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963601654600/0xc40acec91532e56d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e566 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383228.449677:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601654600, rc 0) 00000100:00100000:3.0:1787383228.450144:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984830720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 543us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.450585:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984830720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383228.450603:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e56d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.450629:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e56d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383228.450792:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787383228.452260:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984830848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.452334:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.452374:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383228.452651:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984830848 00000100:00100000:1.0:1787383228.452660:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984830848 00000100:00100000:1.0:1787383228.452714:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787383228.452724:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984830848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383228.453021:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984830848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383228.453030:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787383228.455688:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984830848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.455754:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984830976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.455852:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.455894:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383228.456902:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984830976 00000100:00100000:2.0:1787383228.456912:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984830976 00000100:00100000:2.0:1787383228.456961:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787383228.456971:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984830976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.457092:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984830976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.457099:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787383228.457176:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984830976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.457393:0:10468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10468:1874206984831104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383228.457432:0:10468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.457454:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984831104 00000100:00100000:2.0:1787383228.457458:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984831104 00000100:00100000:2.0:1787383228.457494:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787383228.457501:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+22:10468:x1874206984831104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383228.457578:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+22:10468:x1874206984831104:12345-0@lo:502:llog_process_th.0 Request processed in 77us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.457585:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787383228.457624:0:10468:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383228.457637:0:10468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10468:1874206984831104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787383228.457657:0:10468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383228.457666:0:10468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383228.457669:0:10468:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787383228.457676:0:10468:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96363d95c800 00000020:00000080:2.0:1787383228.457678:0:10468:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787383228.458160:0:10468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10468:1874206984831232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383228.458199:0:10468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.458220:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984831232 00000100:00100000:2.0:1787383228.458224:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984831232 00000100:00100000:2.0:1787383228.458249:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787383228.458255:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:10468:x1874206984831232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383228.458318:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:10468:x1874206984831232:12345-0@lo:502:llog_process_th.0 Request processed in 62us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.458325:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787383228.458381:0:10468:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383228.458395:0:10468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10468:1874206984831232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787383228.458415:0:10468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383228.458421:0:10468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383228.458423:0:10468:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787383228.458428:0:10468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787383228.458479:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787383228.458495:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383228.458504:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e56d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.458514:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e56d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383228.458523:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787383228.458526:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9636183cf000 from 4 10000000:01000000:2.0:1787383228.458529:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787383228.458556:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.458564:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.458572:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383228.458585:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984831360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.458621:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.458635:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383228.458647:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984831360 00000100:00100000:2.0:1787383228.458656:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984831360 00000100:00100000:2.0:1787383228.458677:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787383228.458683:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984831360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383228.458692:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383228.458704:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b6800/0xc40acec91532e57b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e574 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.458724:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b6800/0xc40acec91532e57b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e574 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.458735:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b6800/0xc40acec91532e57b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e574 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.458744:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b6800, rc 0) 00000100:00100000:2.0:1787383228.458792:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984831360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.458798:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787383228.458828:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984831360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383228.458839:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e57b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.458849:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e57b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383228.458891:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984831488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.458915:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.458927:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383228.458938:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984831488 00000100:00100000:2.0:1787383228.458948:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984831488 00000100:00100000:2.0:1787383228.458971:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787383228.458976:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984831488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.459065:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984831488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.459072:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787383228.459103:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984831488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.459131:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984831616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.459164:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.459180:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383228.459191:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984831616 00000100:00100000:2.0:1787383228.459194:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984831616 00000100:00100000:2.0:1787383228.459214:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787383228.459220:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984831616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.459283:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984831616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.459289:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787383228.459322:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984831616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383228.463596:0:10469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10469:1874206984831744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383228.463686:0:10469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.463907:0:10469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635022e00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383228.463956:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984831744 00000100:00100000:2.0:1787383228.463963:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984831744 00000100:00100000:2.0:1787383228.464013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787383228.464023:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+23:10469:x1874206984831744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383228.464245:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+23:10469:x1874206984831744:12345-0@lo:502:llog_process_th.0 Request processed in 128us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.464253:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787383228.464830:0:10469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10469:1874206984831744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383228.464864:0:10469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383228.464875:0:10469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383228.464877:0:10469:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787383228.464883:0:10469:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9636183cf000 00000020:00000080:0.0:1787383228.464886:0:10469:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787383228.464967:0:10469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10469:1874206984831872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383228.465010:0:10469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383228.465037:0:10469:0:(client.c:2702:ptlrpc_set_wait()) set ffff963606513600 going to sleep for 11 seconds 00000100:00100000:2.0:1787383228.465991:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984831872 00000100:00100000:2.0:1787383228.466000:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984831872 00000100:00100000:2.0:1787383228.466088:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787383228.466099:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+23:10469:x1874206984831872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383228.466246:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+23:10469:x1874206984831872:12345-0@lo:502:llog_process_th.0 Request processed in 149us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.466254:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787383228.466382:0:10469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10469:1874206984831872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383228.466422:0:10469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383228.466429:0:10469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383228.466431:0:10469:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787383228.466436:0:10469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787383228.466942:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787383228.466962:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383228.466971:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e57b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.466981:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e57b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383228.466991:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787383228.466994:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9636064d1800 from 4 10000000:01000000:2.0:1787383228.466996:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787383228.467025:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.467033:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383228.467041:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383228.467060:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984832000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.467096:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.467248:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383228.469279:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984832000 00000100:00100000:3.0:1787383228.469292:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984832000 00000100:00100000:3.0:1787383228.469381:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787383228.469391:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984832000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383228.469416:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383228.469432:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963601654e00/0xc40acec91532e589 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e582 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383228.469457:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963601654e00/0xc40acec91532e589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e582 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383228.469467:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963601654e00/0xc40acec91532e589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e582 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383228.471261:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601654e00, rc 0) 00000100:00100000:3.0:1787383228.471342:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984832000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1950us (4242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383228.471351:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787383228.473485:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984832000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383228.473520:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e589 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383228.473533:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e589 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383228.473625:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984832128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383228.473683:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.473912:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635022e0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787383228.477328:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984832128 00000100:00100000:2.0:1787383228.477339:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984832128 00000100:00100000:2.0:1787383228.477491:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787383228.477502:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984832128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.477682:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984832128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (3999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.477690:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787383228.478071:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984832128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383228.478123:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984832256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383228.478184:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.479141:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635022e0540 going to sleep for 11 seconds 00000100:00100000:0.0:1787383228.479334:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984832256 00000100:00100000:0.0:1787383228.479341:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984832256 00000100:00100000:0.0:1787383228.479377:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787383228.479385:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984832256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383228.480122:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984832256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 733us (1933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383228.480132:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787383228.481920:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984832256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383228.482670:0:10472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10472:1874206984832384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383228.483658:0:10472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.483799:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984832384 00000100:00100000:3.0:1787383228.483806:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984832384 00000100:00100000:3.0:1787383228.483851:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787383228.483862:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:10472:x1874206984832384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383228.483986:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:10472:x1874206984832384:12345-0@lo:502:llog_process_th.0 Request processed in 126us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383228.483994:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787383228.484095:0:10472:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6780 going to sleep for 11 seconds 00000100:00100000:2.0:1787383228.484116:0:10472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10472:1874206984832384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787383228.484144:0:10472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383228.484380:0:10472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383228.484383:0:10472:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787383228.484391:0:10472:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9636064d1800 00000020:00000080:2.0:1787383228.484394:0:10472:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787383228.485258:0:10472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10472:1874206984832512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383228.485328:0:10472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.485356:0:10472:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6780 going to sleep for 11 seconds 00000100:00100000:3.0:1787383228.485653:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984832512 00000100:00100000:3.0:1787383228.485660:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984832512 00000100:00100000:2.0:1787383228.491829:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787383228.491843:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:10472:x1874206984832512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383228.492000:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:10472:x1874206984832512:12345-0@lo:502:llog_process_th.0 Request processed in 159us (6671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.492007:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787383228.492077:0:10472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:10472:1874206984832512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787383228.492114:0:10472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383228.492123:0:10472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383228.492126:0:10472:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787383228.492131:0:10472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787383228.493450:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787383228.493672:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383228.493684:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e589 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383228.493810:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e589 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383228.570889:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984832768:0@lo:400:kworker.0 00000100:00100000:2.0:1787383228.570939:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984832640:0@lo:400:kworker.0 00000100:00100000:3.0:1787383228.570951:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.571014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.571015:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984833280:0@lo:400:kworker.0 00000100:00100000:2.0:1787383228.571034:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984833152:0@lo:400:kworker.0 00000100:00100000:3.0:1787383228.571037:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.571052:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.571057:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984833792:0@lo:400:kworker.0 00000100:00100000:2.0:1787383228.571067:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984833664:0@lo:400:kworker.0 00000100:00100000:3.0:1787383228.571074:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.571083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.571113:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984832768 00000100:00100000:3.0:1787383228.571120:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984832768 00000100:00100000:2.0:1787383228.571120:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984832896:0@lo:400:kworker.0 00000100:00100000:2.0:1787383228.571142:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.571152:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984833408:0@lo:400:kworker.0 00000100:00100000:3.0:1787383228.571164:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787383228.571172:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984832768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383228.571172:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383228.571186:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984833920:0@lo:400:kworker.0 00000100:00100000:2.0:1787383228.571201:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.571216:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984832768:12345-0@lo:400:kworker.0 Request processed in 46us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.571217:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787383228.571221:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984833024:0@lo:400:kworker.0 00000100:00100000:3.0:1787383228.571224:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787383228.571246:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984832640 00000100:00100000:3.0:1787383228.571249:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984832640 00000100:00100000:2.0:1787383228.571254:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.571265:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984833280 00000100:00100000:3.0:1787383228.571268:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984833280 00000100:00100000:2.0:1787383228.571270:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984833536:0@lo:400:kworker.0 00000100:00100000:3.0:1787383228.571287:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984833152 00000100:00100000:2.0:1787383228.571289:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.571290:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984833152 00000100:00100000:3.0:1787383228.571301:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984833792 00000100:00100000:3.0:1787383228.571304:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984833792 00000100:00100000:3.0:1787383228.571315:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984833664 00000100:00100000:2.0:1787383228.571315:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984834048:0@lo:400:kworker.0 00000100:00100000:3.0:1787383228.571317:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984833664 00000100:00100000:3.0:1787383228.571326:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984832896 00000100:00100000:3.0:1787383228.571328:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984832896 00000100:00100000:2.0:1787383228.571334:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383228.571339:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787383228.571344:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984832640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383228.571362:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787383228.571369:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984833280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383228.571389:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984832640:12345-0@lo:400:kworker.0 Request processed in 45us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383228.571396:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787383228.571402:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984833280:12345-0@lo:400:kworker.0 Request processed in 34us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383228.571407:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787383228.571504:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984833152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383228.571533:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984833152:12345-0@lo:400:kworker.0 Request processed in 32us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.571664:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787383228.571689:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787383228.571784:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984833792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383228.571815:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984833792:12345-0@lo:400:kworker.0 Request processed in 120us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.571822:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787383228.571834:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787383228.571840:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984833664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383228.571863:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984833664:12345-0@lo:400:kworker.0 Request processed in 24us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.571869:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787383228.571879:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787383228.571885:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984832896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383228.571915:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984832896:12345-0@lo:400:kworker.0 Request processed in 30us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.571920:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787383228.571939:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984833408 00000100:00100000:2.0:1787383228.571942:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984833408 00000100:00100000:2.0:1787383228.572075:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984833920 00000100:00100000:2.0:1787383228.572079:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984833920 00000100:00100000:3.0:1787383228.572169:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787383228.572199:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984833024 00000100:00100000:3.0:1787383228.572203:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984833024 00000100:00100000:3.0:1787383228.572221:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787383228.572227:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984833024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383228.572258:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984833024:12345-0@lo:400:kworker.0 Request processed in 31us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383228.572263:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1787383228.572297:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f992d80 x1874206984833280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383228.572310:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984833280:0@lo:400:kworker.0 00010000:00080000:3.0:1787383228.572321:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f992a00 x1874206984833792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383228.572329:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984833792:0@lo:400:kworker.0 00000100:00100000:3.0:1787383228.572337:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984832768:0@lo:400:kworker.0 00000100:00100000:2.0:1787383228.572363:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984833536 00000100:00100000:2.0:1787383228.572368:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984833536 00000100:00080000:3.0:1787383228.572375:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383228.572379:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383228.572381:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383228.572383:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383228.572457:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984833024:0@lo:400:kworker.0 00000100:00100000:0.0:1787383228.572467:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984832896:0@lo:400:kworker.0 00000100:00100000:0.0:1787383228.572828:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984834048 00000100:00100000:0.0:1787383228.572832:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984834048 00000100:00100000:0.0:1787383228.572866:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787383228.572871:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984833408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383228.572916:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984833408:12345-0@lo:400:kworker.0 Request processed in 44us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383228.572922:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787383228.572935:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787383228.572941:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984833920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383228.572967:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984833920:12345-0@lo:400:kworker.0 Request processed in 27us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383228.572973:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787383228.572982:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787383228.572987:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984833536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383228.573011:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984833536:12345-0@lo:400:kworker.0 Request processed in 24us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383228.573017:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787383228.573027:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787383228.573032:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984834048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383228.573068:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984834048:12345-0@lo:400:kworker.0 Request processed in 36us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383228.573074:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787383228.573110:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f990700 x1874206984833536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383228.573120:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984833536:0@lo:400:kworker.0 00010000:00080000:0.0:1787383228.573130:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f993100 x1874206984834048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383228.573138:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984834048:0@lo:400:kworker.0 00010000:00080000:0.0:1787383228.573147:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f993800 x1874206984833408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383228.573155:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984833408:0@lo:400:kworker.0 00010000:00080000:0.0:1787383228.573165:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f992300 x1874206984833920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383228.573173:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984833920:0@lo:400:kworker.0 00000100:00080000:1.0:1787383228.573909:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787383228.578687:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984832640:0@lo:400:kworker.0 00000100:00100000:3.0:1787383228.578709:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984833152:0@lo:400:kworker.0 00000100:00100000:3.0:1787383228.578733:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984833664:0@lo:400:kworker.0 00000100:00100000:1.0:1787383228.983412:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383228.983450:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383228.983471:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383228.983488:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383228.983509:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383228.983533:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965898368 00000100:00100000:1.0:1787383228.983541:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965898368 00000100:00100000:1.0:1787383228.983638:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 273 00000100:00100000:1.0:1787383228.983649:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2404:x1874206965898368:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383228.983729:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2404:x1874206965898368:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 81us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383228.983737:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 273 00000100:00100000:1.0:1787383228.983786:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965898880 00000100:00100000:1.0:1787383228.983790:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965898880 00000100:00100000:1.0:1787383228.983823:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965898752 00000100:00100000:1.0:1787383228.983826:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965898752 00000100:00100000:1.0:1787383228.983847:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:1.0:1787383228.983853:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965898880:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383228.983878:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965898880:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383228.983884:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:1.0:1787383228.983895:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:1.0:1787383228.983901:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965898752:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383228.983921:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965898752:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 21us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383228.983926:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00080000:1.0:1787383228.984035:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383228.984046:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383228.988204:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965898624 00000100:00100000:2.0:1787383228.988347:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965898624 00000100:00100000:2.0:1787383228.988446:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965898496 00000100:00100000:2.0:1787383228.988467:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965898496 00000100:00100000:0.0:1787383228.988490:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:0.0:1787383228.988502:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965898624:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383228.988591:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965898624:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 90us (5138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383228.988599:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00080000:3.0:1787383228.989128:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383228.989133:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383228.989318:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:2.0:1787383228.989328:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965898496:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383228.989464:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965898496:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 136us (5972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383228.989471:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00010000:00010000:0.0:1787383229.082925:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383229.083008:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984834176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383229.083092:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383229.083164:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984834176 00000100:00100000:0.0:1787383229.083170:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984834176 00000100:00100000:0.0:1787383229.083210:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787383229.083219:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984834176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383229.083246:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383229.083295:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984834176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383229.083312:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787383229.083394:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cd0380 x1874206984834176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383229.083412:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984834176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383229.083565:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383229.083575:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984834304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383229.083612:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383229.083636:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984834304 00000100:00100000:1.0:1787383229.083640:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984834304 00000100:00100000:1.0:1787383229.083683:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383229.083689:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984834304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787383229.083700:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383229.083729:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984834304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383229.083735:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787383229.083759:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3ed80 x1874206984834304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383229.083787:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984834304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383229.595970:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984834432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383229.596039:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383229.597452:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984834432 00000100:00100000:3.0:1787383229.597465:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984834432 00000100:00100000:3.0:1787383229.597565:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787383229.597575:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984834432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787383229.597616:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787383229.597691:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984834432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383229.597698:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787383229.597981:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984834432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383230.107020:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383230.107054:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984834560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383230.110059:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984834688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383230.110197:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383230.110261:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383230.110362:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984834688 00000100:00100000:0.0:1787383230.110372:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984834688 00000100:00100000:2.0:1787383230.110501:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984834560 00000100:00100000:2.0:1787383230.110506:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984834560 00000100:00100000:0.0:1787383230.111020:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787383230.111033:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984834688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383230.111066:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383230.111176:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984834688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383230.111183:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1787383230.111271:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787383230.120306:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787383230.120401:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d43b80 x1874206984834688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383230.120436:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984834688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383230.129752:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787383230.129781:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984834560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787383230.129810:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383230.129983:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984834560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 220us (19731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383230.129990:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787383230.130044:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cd3480 x1874206984834560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383230.130065:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984834560:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787383231.133468:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383232.154871:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383232.668053:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984834816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383232.668124:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383232.668372:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984834816 00000100:00100000:3.0:1787383232.668391:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984834816 00000100:00100000:3.0:1787383232.668448:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787383232.668459:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984834816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787383232.669032:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787383232.669166:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984834816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 707us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383232.669175:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787383232.670325:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984834816:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1787383232.747495:0:10695:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787383233.187034:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383233.691452:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984835200:0@lo:400:kworker.0 00000100:00100000:1.0:1787383233.691532:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383233.691583:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984835712:0@lo:400:kworker.0 00000100:00100000:1.0:1787383233.691606:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383233.691634:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984836224:0@lo:400:kworker.0 00000100:00100000:1.0:1787383233.691654:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383233.691683:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787383233.691691:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984835328:0@lo:400:kworker.0 00000100:00100000:1.0:1787383233.691712:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383233.691727:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984835840:0@lo:400:kworker.0 00000100:00100000:1.0:1787383233.691749:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383233.691915:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984836352:0@lo:400:kworker.0 00000100:00100000:1.0:1787383233.691941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383233.691983:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984835200 00000100:00100000:1.0:1787383233.691990:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984835200 00000100:00100000:1.0:1787383233.692030:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787383233.692039:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984835200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383233.692090:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984835200:12345-0@lo:400:kworker.0 Request processed in 51us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383233.692097:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787383233.692121:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984835712 00000100:00100000:1.0:1787383233.692125:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984835712 00000100:00100000:1.0:1787383233.692152:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984836224 00000100:00100000:1.0:1787383233.692156:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984836224 00000100:00100000:1.0:1787383233.692171:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984835328 00000100:00100000:1.0:1787383233.692174:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984835328 00000100:00100000:1.0:1787383233.692188:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787383233.692194:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984835712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383233.692223:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984835712:12345-0@lo:400:kworker.0 Request processed in 30us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383233.692230:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787383233.692247:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787383233.692253:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984836224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383233.692282:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984836224:12345-0@lo:400:kworker.0 Request processed in 29us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383233.692288:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787383233.692303:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787383233.692308:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984835328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383233.692333:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984835328:12345-0@lo:400:kworker.0 Request processed in 25us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383233.692339:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787383233.692359:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984835840 00000100:00100000:1.0:1787383233.692362:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984835840 00000100:00100000:1.0:1787383233.692386:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984836352 00000100:00100000:1.0:1787383233.692389:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984836352 00000100:00100000:1.0:1787383233.692405:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787383233.692411:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984835840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383233.692437:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984835840:12345-0@lo:400:kworker.0 Request processed in 26us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383233.692443:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787383233.692453:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383233.692458:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984836352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383233.692480:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984836352:12345-0@lo:400:kworker.0 Request processed in 22us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383233.692486:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383233.692536:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984835328:0@lo:400:kworker.0 00010000:00080000:1.0:1787383233.692549:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2ca80 x1874206984835840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383233.692566:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984835840:0@lo:400:kworker.0 00010000:00080000:1.0:1787383233.692596:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2c700 x1874206984836352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383233.692604:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984836352:0@lo:400:kworker.0 00000100:00100000:1.0:1787383233.692613:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984835200:0@lo:400:kworker.0 00010000:00080000:1.0:1787383233.692621:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2d880 x1874206984835712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383233.692628:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984835712:0@lo:400:kworker.0 00010000:00080000:1.0:1787383233.692636:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2ce00 x1874206984836224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383233.692642:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984836224:0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.692882:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984835072:0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.692916:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383233.692936:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984835584:0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.692956:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383233.692977:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984836096:0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.692996:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383233.693014:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787383233.693020:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984834944:0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693046:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383233.693066:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984835456:0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693085:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383233.693100:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984835968:0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693119:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383233.693135:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984836480:0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693154:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383233.693176:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984835072 00000100:00100000:3.0:1787383233.693180:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984835072 00000100:00100000:3.0:1787383233.693202:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984835584 00000100:00100000:3.0:1787383233.693204:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984835584 00000100:00100000:3.0:1787383233.693216:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984836096 00000100:00100000:3.0:1787383233.693218:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984836096 00000100:00100000:3.0:1787383233.693231:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787383233.693237:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984835072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693275:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984835072:12345-0@lo:400:kworker.0 Request processed in 39us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383233.693280:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787383233.693300:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787383233.693305:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984835584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693332:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984835584:12345-0@lo:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383233.693341:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787383233.693351:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787383233.693357:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984836096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693378:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984836096:12345-0@lo:400:kworker.0 Request processed in 22us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383233.693383:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787383233.693402:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984835456 00000100:00100000:3.0:1787383233.693405:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984835456 00000100:00100000:3.0:1787383233.693423:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787383233.693427:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984835456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693454:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984835456:12345-0@lo:400:kworker.0 Request processed in 26us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383233.693459:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787383233.693476:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383233.693480:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383233.693483:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383233.693485:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383233.693493:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984834944 00000100:00100000:3.0:1787383233.693497:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984834944 00000100:00100000:3.0:1787383233.693533:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787383233.693540:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984834944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693564:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984834944:12345-0@lo:400:kworker.0 Request processed in 26us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383233.693591:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787383233.693619:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984835968 00000100:00100000:3.0:1787383233.693623:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984835968 00000100:00100000:3.0:1787383233.693650:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984836480 00000100:00100000:3.0:1787383233.693653:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984836480 00000100:00100000:3.0:1787383233.693664:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383233.693670:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984835968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693696:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984835968:12345-0@lo:400:kworker.0 Request processed in 27us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383233.693702:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383233.693711:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787383233.693717:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984836480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693739:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984836480:12345-0@lo:400:kworker.0 Request processed in 23us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383233.693743:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787383233.693760:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383233.693762:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383233.693820:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984834944:0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693831:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984835456:0@lo:400:kworker.0 00010000:00080000:3.0:1787383233.693841:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2f800 x1874206984835968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383233.693849:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984835968:0@lo:400:kworker.0 00010000:00080000:3.0:1787383233.693858:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2dc00 x1874206984836480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383233.693866:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984836480:0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693884:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984835072:0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693892:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984835584:0@lo:400:kworker.0 00000100:00100000:3.0:1787383233.693900:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984836096:0@lo:400:kworker.0 00000100:00100000:1.0:1787383234.107045:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383234.107088:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383234.107118:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383234.107141:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383234.107166:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383234.107190:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965899520 00000100:00100000:1.0:1787383234.107199:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965899520 00000100:00100000:1.0:1787383234.107245:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965899392 00000100:00100000:1.0:1787383234.107248:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965899392 00000100:00100000:1.0:1787383234.107269:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:1.0:1787383234.107278:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965899520:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383234.107341:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965899520:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383234.107355:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:1.0:1787383234.107372:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:1.0:1787383234.107378:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362db0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965899392:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383234.107401:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362db0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965899392:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383234.107407:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:1.0:1787383234.107544:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965899264 00000100:00100000:1.0:1787383234.107548:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965899264 00000100:00100000:1.0:1787383234.107587:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965899136 00000100:00100000:1.0:1787383234.107590:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965899136 00000100:00100000:1.0:1787383234.107613:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 75 00000100:00100000:1.0:1787383234.107619:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965899264:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383234.107650:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965899264:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 30us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383234.107655:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 75 00000100:00100000:1.0:1787383234.107668:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 76 00000100:00100000:1.0:1787383234.112099:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2402:x1874206965899136:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383234.112190:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2402:x1874206965899136:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 4516us (5047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383234.112202:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 76 00000100:00080000:1.0:1787383234.112244:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383234.112251:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383234.112255:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383234.112258:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383234.113641:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965899008 00000100:00100000:2.0:1787383234.113652:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965899008 00000100:00100000:2.0:1787383234.113719:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 275 00000100:00100000:2.0:1787383234.113728:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2402:x1874206965899008:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383234.113823:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2402:x1874206965899008:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 96us (6787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383234.113831:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 275 00000100:00100000:0.0:1787383234.202982:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383234.203006:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984836608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383234.203074:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383234.203174:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383234.203892:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984836608 00000100:00100000:2.0:1787383234.203908:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984836608 00000100:00100000:2.0:1787383234.203960:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787383234.203970:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984836608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787383234.204014:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383234.204076:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984836608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383234.204084:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787383234.204145:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2d180 x1874206984836608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383234.204164:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984836608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383234.205087:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984836736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383234.205144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383234.205538:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984836736 00000100:00100000:3.0:1787383234.205545:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984836736 00000100:00100000:3.0:1787383234.205602:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383234.205610:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984836736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383234.205629:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383234.205670:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984836736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383234.205677:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787383234.205750:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d42680 x1874206984836736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383234.205803:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984836736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383234.715028:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383234.715053:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984836864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383234.715133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383234.717023:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984836864 00000100:00100000:3.0:1787383234.717036:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984836864 00000100:00100000:3.0:1787383234.717099:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787383234.717108:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984836864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787383234.717139:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787383234.717373:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984836864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 266us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383234.717381:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787383234.720693:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984836864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383235.226926:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984836992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383235.227012:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383235.227065:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984836992 00000100:00100000:2.0:1787383235.227073:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984836992 00000100:00100000:2.0:1787383235.227148:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787383235.227162:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984836992:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787383235.227186:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787383235.227193:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383235.227248:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984836992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383235.227255:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787383235.227275:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635033baa00 x1874206984836992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383235.227294:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984836992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383235.227914:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383235.227925:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984837120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383235.227954:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383235.227991:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984837120 00000100:00100000:3.0:1787383235.227996:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984837120 00000100:00100000:3.0:1787383235.228039:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787383235.228046:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984837120:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787383235.228047:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787383235.228059:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383235.228098:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984837120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383235.228104:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787383235.228215:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d43100 x1874206984837120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383235.228232:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984837120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787383235.228320:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383236.251937:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383237.275122:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383237.787288:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383237.787323:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984837248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383237.787417:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383237.787520:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984837248 00000100:00100000:3.0:1787383237.787532:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984837248 00000100:00100000:3.0:1787383237.787602:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787383237.787612:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984837248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787383237.787658:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787383237.787706:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984837248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383237.787713:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787383237.787792:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984837248:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787383238.300620:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787383238.749145:0:10939:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing yml_node 00000100:00100000:2.0:1787383238.811335:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984837760:0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.811405:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383238.811454:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984838272:0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.811481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383238.811512:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787383238.811527:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984837376:0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.811564:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383238.811587:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984837888:0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.811621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383238.811648:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984837504:0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.811670:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383238.811683:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984838016:0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.811702:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383238.811718:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787383238.811724:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984837632:0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.811741:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383238.811756:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984838144:0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.811797:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383238.811825:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984837760 00000100:00100000:2.0:1787383238.811832:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984837760 00000100:00100000:2.0:1787383238.811872:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984837504 00000100:00100000:2.0:1787383238.811875:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984837504 00000100:00100000:2.0:1787383238.811886:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984838016 00000100:00100000:2.0:1787383238.811889:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984838016 00000100:00100000:2.0:1787383238.811909:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984838144 00000100:00100000:2.0:1787383238.811921:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984838144 00000100:00100000:2.0:1787383238.811941:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787383238.811949:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984837760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.811998:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984837760:12345-0@lo:400:kworker.0 Request processed in 49us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383238.812006:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787383238.812022:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787383238.812028:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984837504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.812057:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984837504:12345-0@lo:400:kworker.0 Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383238.812076:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787383238.812089:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787383238.812096:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984838016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.812135:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984838016:12345-0@lo:400:kworker.0 Request processed in 40us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383238.812142:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787383238.812153:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787383238.812160:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984838144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.812187:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984838144:12345-0@lo:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383238.812193:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787383238.812209:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984837376 00000100:00100000:2.0:1787383238.812213:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984837376 00000100:00100000:2.0:1787383238.812738:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787383238.812748:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984837376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.812808:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984837376:12345-0@lo:400:kworker.0 Request processed in 61us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383238.812823:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787383238.812860:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984837888 00000100:00100000:2.0:1787383238.812865:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984837888 00000100:00100000:2.0:1787383238.812883:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984837632 00000100:00100000:2.0:1787383238.812885:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984837632 00000100:00100000:2.0:1787383238.812898:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787383238.812903:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984837888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.812936:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984837888:12345-0@lo:400:kworker.0 Request processed in 32us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383238.812943:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787383238.812956:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787383238.812962:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984837632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.812985:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984837632:12345-0@lo:400:kworker.0 Request processed in 24us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383238.812991:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1787383238.813016:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383238.813021:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383238.813034:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984838528:0@lo:400:kworker.0 00000100:00100000:1.0:1787383238.813167:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984838400:0@lo:400:kworker.0 00000100:00100000:1.0:1787383238.813198:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383238.813219:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984838912:0@lo:400:kworker.0 00000100:00100000:1.0:1787383238.813357:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383238.813379:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383238.813386:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984838784:0@lo:400:kworker.0 00000100:00100000:1.0:1787383238.813405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383238.813428:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984838656:0@lo:400:kworker.0 00000100:00100000:1.0:1787383238.813449:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383238.813476:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984838272 00000100:00100000:1.0:1787383238.813480:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984838272 00000100:00100000:1.0:1787383238.813506:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984838400 00000100:00100000:1.0:1787383238.813509:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984838400 00000100:00100000:1.0:1787383238.813660:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984838912 00000100:00100000:1.0:1787383238.813665:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984838912 00000100:00100000:1.0:1787383238.813679:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984838784 00000100:00100000:1.0:1787383238.813681:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984838784 00000100:00100000:1.0:1787383238.813695:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787383238.813701:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984838272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383238.813734:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984838272:12345-0@lo:400:kworker.0 Request processed in 33us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383238.813740:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787383238.813761:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787383238.813784:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984838400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383238.813817:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984838400:12345-0@lo:400:kworker.0 Request processed in 51us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383238.813824:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787383238.813835:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787383238.813841:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984838912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383238.813866:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984838912:12345-0@lo:400:kworker.0 Request processed in 26us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383238.813872:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787383238.813882:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787383238.813888:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984838784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383238.813911:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984838784:12345-0@lo:400:kworker.0 Request processed in 25us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383238.813916:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787383238.813932:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984838656 00000100:00100000:1.0:1787383238.813935:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984838656 00000100:00100000:1.0:1787383238.813959:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787383238.813964:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984838656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383238.813996:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984838656:12345-0@lo:400:kworker.0 Request processed in 31us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383238.814002:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787383238.814685:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383238.814782:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984837632:0@lo:400:kworker.0 00010000:00080000:2.0:1787383238.814798:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d1500 x1874206984838144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383238.814808:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984838144:0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.814820:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984837504:0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.814830:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984838016:0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.814884:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984837376:0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.814896:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984837888:0@lo:400:kworker.0 00000100:00100000:2.0:1787383238.814906:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984837760:0@lo:400:kworker.0 00010000:00080000:2.0:1787383238.814917:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d2680 x1874206984838272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383238.814926:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984838272:0@lo:400:kworker.0 00000100:00080000:2.0:1787383238.815269:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383238.815274:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383238.815277:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383238.819009:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984838528 00000100:00100000:3.0:1787383238.819031:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984838528 00000100:00100000:3.0:1787383238.819210:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787383238.819220:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984838528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383238.819460:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984838528:12345-0@lo:400:kworker.0 Request processed in 240us (4774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383238.819467:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1787383238.822788:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f991880 x1874206984838656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383238.822805:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984838656:0@lo:400:kworker.0 00010000:00080000:1.0:1787383238.822869:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f991180 x1874206984838784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383238.822881:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984838784:0@lo:400:kworker.0 00010000:00080000:1.0:1787383238.822894:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d0a80 x1874206984838400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383238.822902:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984838400:0@lo:400:kworker.0 00010000:00080000:1.0:1787383238.822913:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f991f80 x1874206984838912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383238.822920:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984838912:0@lo:400:kworker.0 00000100:00080000:2.0:1787383238.823877:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383238.823915:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984838528:0@lo:400:kworker.0 00000100:00100000:1.0:1787383239.225944:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383239.226636:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383239.226672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383239.226703:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965899904 00000100:00100000:1.0:1787383239.226712:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965899904 00000100:00100000:1.0:1787383239.226791:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965899776 00000100:00100000:1.0:1787383239.226795:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965899776 00000100:00100000:1.0:1787383239.226821:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 83 00000100:00100000:1.0:1787383239.226830:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965899904:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383239.226901:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965899904:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 72us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383239.226909:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 83 00000100:00100000:1.0:1787383239.226926:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 84 00000100:00100000:1.0:1787383239.226932:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2401:x1874206965899776:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383239.226957:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2401:x1874206965899776:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383239.226971:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 84 00000100:00080000:2.0:1787383239.227143:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383239.227147:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383239.227717:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965899648 00000100:00100000:0.0:1787383239.227724:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965899648 00000100:00100000:0.0:1787383239.227825:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 277 00000100:00100000:0.0:1787383239.227834:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2401:x1874206965899648:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383239.227875:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2401:x1874206965899648:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 43us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383239.227882:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 277 00000100:00100000:3.0:1787383239.234138:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383239.234176:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383239.234267:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965900032 00000100:00100000:2.0:1787383239.234276:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965900032 00000100:00080000:3.0:1787383239.234341:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383239.234354:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965900160 00000100:00100000:2.0:1787383239.234359:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965900160 00000100:00100000:2.0:1787383239.234395:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:2.0:1787383239.234405:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2400:x1874206965900032:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:2.0:1787383239.234441:0:8914:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e49b 00000100:00080000:2.0:1787383239.234450:0:8914:0:(import.c:65:import_set_state_nolock()) ffff9635036f6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787383239.234501:0:8914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1787383239.234634:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787383239.234642:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383239.235097:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+2:2400:x1874206965900032:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 692us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383239.235106:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:2.0:1787383239.235130:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:2.0:1787383239.235138:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2400:x1874206965900160:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:2.0:1787383239.235153:0:8914:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e4a2 00000100:00080000:2.0:1787383239.235160:0:8914:0:(import.c:65:import_set_state_nolock()) ffff9635036f7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787383239.235189:0:8914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787383239.235406:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+2:2400:x1874206965900160:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 269us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383239.235412:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00010000:00010000:2.0:1787383239.235495:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383239.324707:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984839040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383239.324787:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383239.324833:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383239.324839:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984839168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383239.324861:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383239.324889:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383239.324900:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984839040 00000100:00100000:0.0:1787383239.324907:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984839040 00000100:00100000:0.0:1787383239.325083:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984839168 00000100:00100000:0.0:1787383239.325087:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984839168 00000100:00100000:0.0:1787383239.325104:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787383239.325111:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984839040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383239.325138:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383239.325219:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984839040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383239.325234:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787383239.325248:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787383239.325255:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984839168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383239.325264:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383239.325287:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984839168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383239.325292:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787383239.325350:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cd0e00 x1874206984839040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383239.325367:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984839040:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787383239.325388:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f993100 x1874206984839168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383239.325398:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984839168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383239.836168:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984839296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383239.836231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383239.836585:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984839296 00000100:00100000:3.0:1787383239.836593:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984839296 00000100:00100000:3.0:1787383239.836647:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787383239.836656:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984839296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787383239.836687:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787383239.836744:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984839296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383239.836751:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787383239.836858:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984839296:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787383240.347076:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383240.347339:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984839424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383240.347406:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383240.347555:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984839424 00000100:00100000:3.0:1787383240.347562:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984839424 00000100:00100000:3.0:1787383240.347609:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383240.347617:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984839424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787383240.347641:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383240.347676:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984839424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383240.347683:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787383240.347700:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383240.347731:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383240.347741:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984839552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383240.347781:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383240.347800:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984839552 00000100:00100000:3.0:1787383240.347803:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984839552 00000100:00100000:3.0:1787383240.347822:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787383240.347828:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984839552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383240.347837:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383240.347859:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984839552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383240.347865:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787383240.347874:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787383240.347894:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f990000 x1874206984839552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383240.347923:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984839552:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787383240.348139:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635033b9500 x1874206984839424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383240.348151:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984839424:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787383241.371532:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383242.395366:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383242.907790:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383242.907813:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984839680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383242.907883:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383242.907955:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984839680 00000100:00100000:3.0:1787383242.907963:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984839680 00000100:00100000:3.0:1787383242.908009:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787383242.908019:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984839680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787383242.908053:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787383242.908097:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984839680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383242.908104:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787383242.908171:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984839680:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787383242.999324:0:11122:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.114 00010000:00010000:0.0:1787383243.421978:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383243.933351:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984840064:0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.933416:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383243.933591:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984840576:0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.933621:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383243.933643:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350338b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984841088:0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.933663:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383243.933692:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787383243.933698:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984840192:0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.933718:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383243.933735:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984840704:0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.933758:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383243.933802:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350338bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984841216:0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.933822:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383243.933861:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984840064 00000100:00100000:3.0:1787383243.933868:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984840064 00000100:00100000:3.0:1787383243.933914:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787383243.933923:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984840064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.934059:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984840064:12345-0@lo:400:kworker.0 Request processed in 136us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383243.934067:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787383243.934094:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984840576 00000100:00100000:3.0:1787383243.934098:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984840576 00000100:00100000:3.0:1787383243.934129:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984841088 00000100:00100000:3.0:1787383243.934132:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984841088 00000100:00100000:3.0:1787383243.934151:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984840192 00000100:00100000:3.0:1787383243.934162:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984840192 00000100:00100000:3.0:1787383243.934178:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787383243.934183:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984840576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.934299:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984839808:0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.934333:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383243.934358:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984840320:0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.934378:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383243.934393:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984840832:0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.934414:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383243.934428:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984841344:0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.934471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383243.934490:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787383243.934496:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984839936:0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.934527:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383243.934538:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984840448:0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.934555:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383243.934564:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984840960:0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.934582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383243.934602:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984840704 00000100:00100000:0.0:1787383243.934606:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984840704 00000100:00100000:0.0:1787383243.934627:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984841216 00000100:00100000:0.0:1787383243.934630:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984841216 00000100:00100000:0.0:1787383243.934641:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984840832 00000100:00100000:0.0:1787383243.934644:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984840832 00000100:00100000:0.0:1787383243.934656:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984841344 00000100:00100000:0.0:1787383243.934658:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984841344 00000100:00100000:0.0:1787383243.934671:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787383243.934677:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984840704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.934707:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984840704:12345-0@lo:400:kworker.0 Request processed in 30us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383243.934712:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787383243.934724:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787383243.934730:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984841216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.934755:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984841216:12345-0@lo:400:kworker.0 Request processed in 25us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383243.934760:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787383243.934790:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787383243.934803:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984840832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.934835:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984840832:12345-0@lo:400:kworker.0 Request processed in 33us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383243.934841:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787383243.934851:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787383243.934857:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984841344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.934882:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984841344:12345-0@lo:400:kworker.0 Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383243.934888:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787383243.934921:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503389c00 x1874206984840832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383243.934934:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984840832:0@lo:400:kworker.0 00010000:00080000:0.0:1787383243.934943:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503389500 x1874206984841344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383243.934951:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984841344:0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.935166:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984840576:12345-0@lo:400:kworker.0 Request processed in 982us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383243.935173:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787383243.935185:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984839936 00000100:00100000:3.0:1787383243.935188:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984839936 00000100:00100000:3.0:1787383243.935277:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984840448 00000100:00100000:3.0:1787383243.935281:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984840448 00000100:00100000:3.0:1787383243.935294:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984840960 00000100:00100000:3.0:1787383243.935296:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984840960 00000100:00100000:3.0:1787383243.935310:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787383243.935316:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984841088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.935346:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984841088:12345-0@lo:400:kworker.0 Request processed in 31us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383243.935352:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787383243.935363:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787383243.935368:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984840192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.935394:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984840192:12345-0@lo:400:kworker.0 Request processed in 26us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383243.935400:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787383243.935412:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787383243.935417:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984839936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383243.935552:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787383243.935561:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984840448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.935623:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984839936:12345-0@lo:400:kworker.0 Request processed in 205us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383243.935629:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787383243.935649:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787383243.935656:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984840960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383243.935738:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984840448:12345-0@lo:400:kworker.0 Request processed in 178us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383243.935744:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787383243.936743:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984840960:12345-0@lo:400:kworker.0 Request processed in 1085us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383243.936751:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787383243.936818:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984840320 00000100:00100000:3.0:1787383243.936824:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984840320 00000100:00100000:3.0:1787383243.936850:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787383243.936856:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984840320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.936901:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984840320:12345-0@lo:400:kworker.0 Request processed in 44us (2521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383243.936907:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787383243.936925:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383243.936929:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383243.936933:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383243.936935:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383243.936952:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984839808 00000100:00100000:3.0:1787383243.936956:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984839808 00000100:00100000:3.0:1787383243.936999:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787383243.937006:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984839808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.937036:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984839808:12345-0@lo:400:kworker.0 Request processed in 31us (2702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383243.937042:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787383243.937092:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984840192:0@lo:400:kworker.0 00010000:00080000:3.0:1787383243.937105:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f991880 x1874206984840704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383243.937116:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984840704:0@lo:400:kworker.0 00010000:00080000:3.0:1787383243.937138:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350338bb80 x1874206984841216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383243.937146:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350338bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984841216:0@lo:400:kworker.0 00000100:00100000:3.0:1787383243.937158:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984840064:0@lo:400:kworker.0 00010000:00080000:3.0:1787383243.937169:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f991180 x1874206984840576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383243.937178:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984840576:0@lo:400:kworker.0 00010000:00080000:3.0:1787383243.937188:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350338b480 x1874206984841088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383243.937303:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350338b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984841088:0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.937602:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984839936:0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.937618:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984840448:0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.937628:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984840960:0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.937637:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984839808:0@lo:400:kworker.0 00000100:00100000:0.0:1787383243.937647:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984840320:0@lo:400:kworker.0 00000100:00100000:3.0:1787383244.347863:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383244.348982:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383244.349012:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383244.349121:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965900544 00000100:00100000:2.0:1787383244.349141:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965900544 00000100:00100000:2.0:1787383244.349207:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965900416 00000100:00100000:2.0:1787383244.349211:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965900416 00000100:00100000:2.0:1787383244.349234:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 91 00000100:00100000:2.0:1787383244.349245:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965900544:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383244.349333:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965900544:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 90us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383244.349340:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 91 00000100:00100000:2.0:1787383244.349357:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 92 00000100:00100000:2.0:1787383244.349380:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965900416:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383244.349407:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965900416:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383244.349413:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 92 00000100:00080000:3.0:1787383244.351372:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383244.351382:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383244.352906:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965900288 00000100:00100000:0.0:1787383244.352920:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965900288 00000100:00100000:1.0:1787383244.353305:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 279 00000100:00100000:1.0:1787383244.353327:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2403:x1874206965900288:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383244.353394:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2403:x1874206965900288:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 79us (5538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383244.353411:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 279 00010000:00010000:3.0:1787383244.443351:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383244.443753:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984841472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383244.443846:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383244.444337:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984841472 00000100:00100000:3.0:1787383244.444345:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984841472 00000100:00100000:3.0:1787383244.444398:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787383244.444408:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984841472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383244.444434:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383244.444491:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984841472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383244.444508:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787383244.444606:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503389880 x1874206984841472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383244.444623:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984841472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383244.444782:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383244.444800:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984841600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383244.444832:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383244.445361:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984841600 00000100:00100000:0.0:1787383244.445366:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984841600 00000100:00100000:0.0:1787383244.445394:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787383244.445401:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984841600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383244.445418:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383244.445465:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984841600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383244.445471:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787383244.445634:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cd2680 x1874206984841600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383244.445649:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984841600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383244.956674:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383244.956697:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350338aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984841728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383244.956761:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383244.956843:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984841728 00000100:00100000:3.0:1787383244.956851:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984841728 00000100:00100000:3.0:1787383244.957946:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787383244.957961:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984841728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787383244.957996:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787383244.958056:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984841728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383244.958064:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787383244.958110:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350338aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984841728:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1787383244.959882:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000020:00000080:1.0:1787383244.959889:0:8429:0:(genops.c:906:class_export_put()) final put ffff9635036f7800/a75c5b6d-4c9e-4295-9df6-097efce92717 00000020:00000080:2.0:1787383244.960032:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9635036f7800/a75c5b6d-4c9e-4295-9df6-097efce92717 for lustre-OST0000 00000020:00000080:2.0:1787383244.960085:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9635036f6800 for lustre-OST0000 00000001:00100000:2.0:1787383244.960732:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000020:00000080:2.0:1787383244.960738:0:9513:0:(genops.c:906:class_export_put()) final put ffff9635036f5800/a75c5b6d-4c9e-4295-9df6-097efce92717 00000020:00000080:0.0:1787383244.960810:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9635036f5800/a75c5b6d-4c9e-4295-9df6-097efce92717 for lustre-OST0001 00000020:00000080:0.0:1787383244.960850:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9635036f7000 for lustre-OST0001 00000100:00100000:3.0:1787383245.467291:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350338aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984841856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383245.467359:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383245.467431:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984841856 00000100:00100000:3.0:1787383245.467439:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984841856 00000100:00100000:3.0:1787383245.467489:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787383245.467507:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984841856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383245.467533:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383245.467573:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984841856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383245.467581:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787383245.467604:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787383245.467639:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350338aa00 x1874206984841856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787383245.468814:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383245.469465:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350338aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984841856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383245.469513:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383245.469523:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984841984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383245.469575:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383245.469624:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984841984 00000100:00100000:1.0:1787383245.469632:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984841984 00000100:00100000:1.0:1787383245.469682:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787383245.469691:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984841984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383245.469711:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383245.469749:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984841984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383245.469756:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787383245.470408:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362da0aa00 x1874206984841984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383245.470425:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984841984:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787383245.470454:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1787383245.799608:0:11220:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.114 00010000:00010000:3.0:1787383246.491949:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383247.516241:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383248.030064:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383248.030088:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984842112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787383248.030157:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383248.030243:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984842112 00000100:00100000:1.0:1787383248.030252:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984842112 00000100:00100000:1.0:1787383248.030311:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787383248.030322:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984842112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383248.030359:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383248.030407:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984842112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383248.030425:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787383248.030490:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984842112:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787383248.548150:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787383248.675679:0:11317:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.114 00000100:00100000:1.0:1787383249.051594:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984842496:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.051687:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383249.051755:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984843008:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.051828:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383249.051856:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984843520:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.051879:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383249.051911:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787383249.051918:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984842368:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.051939:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383249.051957:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984842880:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.051980:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383249.051997:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984843392:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.052018:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383249.052068:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984842496 00000100:00100000:1.0:1787383249.052076:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984842496 00000100:00100000:1.0:1787383249.052130:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787383249.052140:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984842496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.052207:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984842496:12345-0@lo:400:kworker.0 Request processed in 66us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383249.052215:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787383249.052225:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984842240:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.052248:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984843008 00000100:00100000:1.0:1787383249.052253:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984843008 00000100:00100000:2.0:1787383249.052280:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383249.052290:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984843520 00000100:00100000:1.0:1787383249.052294:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984843520 00000100:00100000:1.0:1787383249.052311:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984842368 00000100:00100000:1.0:1787383249.052313:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984842368 00000100:00100000:1.0:1787383249.052324:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984842880 00000100:00100000:1.0:1787383249.052326:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984842880 00000100:00100000:1.0:1787383249.052339:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984843392 00000100:00100000:1.0:1787383249.052340:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984843392 00000100:00100000:1.0:1787383249.052353:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787383249.052366:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984843008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.052402:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984843008:12345-0@lo:400:kworker.0 Request processed in 36us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383249.052409:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787383249.052425:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984842752:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.052428:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787383249.052439:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984843520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383249.052462:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383249.052488:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984843520:12345-0@lo:400:kworker.0 Request processed in 50us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383249.052495:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787383249.052498:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984843264:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.052508:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787383249.052516:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984842368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383249.052528:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383249.052553:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984843776:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.052559:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984842368:12345-0@lo:400:kworker.0 Request processed in 41us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383249.052568:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787383249.052583:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383249.052584:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787383249.052593:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984842880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383249.052608:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787383249.052617:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984842624:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.052630:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984842880:12345-0@lo:400:kworker.0 Request processed in 37us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383249.052637:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787383249.052644:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383249.052650:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984842624 00000100:00100000:1.0:1787383249.052655:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984842624 00000100:00100000:2.0:1787383249.052659:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984843136:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.052674:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787383249.052684:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984843392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383249.052685:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383249.052704:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984843648:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.052722:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984843392:12345-0@lo:400:kworker.0 Request processed in 40us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383249.052740:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383249.052748:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787383249.052791:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787383249.052798:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984842624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383249.052803:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984843264 00000100:00100000:2.0:1787383249.052808:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984843264 00000100:00100000:2.0:1787383249.052837:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984843776 00000100:00100000:2.0:1787383249.052840:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984843776 00000100:00100000:1.0:1787383249.052845:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984842624:12345-0@lo:400:kworker.0 Request processed in 47us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383249.052853:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984843136 00000100:00100000:1.0:1787383249.052853:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787383249.052858:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984843136 00000100:00100000:2.0:1787383249.052874:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984843648 00000100:00100000:2.0:1787383249.052876:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984843648 00000100:00100000:2.0:1787383249.052892:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787383249.052899:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984843264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.052902:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984842752 00000100:00100000:1.0:1787383249.052907:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984842752 00000100:00100000:1.0:1787383249.052934:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787383249.052941:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984843264:12345-0@lo:400:kworker.0 Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383249.052944:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984842752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383249.052955:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787383249.052972:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787383249.052981:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984843776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.052989:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984842752:12345-0@lo:400:kworker.0 Request processed in 47us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383249.052996:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787383249.053018:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984843776:12345-0@lo:400:kworker.0 Request processed in 38us (436us total) trans 0 rc 0/0 00000100:00080000:1.0:1787383249.053019:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383249.053025:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383249.053030:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1787383249.053031:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383249.053035:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383249.053047:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787383249.053050:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984842240 00000100:00100000:2.0:1787383249.053055:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984843136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.053056:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984842240 00000100:00100000:2.0:1787383249.053090:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984843136:12345-0@lo:400:kworker.0 Request processed in 37us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383249.053094:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787383249.053103:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787383249.053105:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984842240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.053141:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984842240:12345-0@lo:400:kworker.0 Request processed in 38us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383249.053147:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787383249.053211:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984842368:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.053223:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984842880:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.053243:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984843392:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.053254:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984842496:0@lo:400:kworker.0 00010000:00080000:1.0:1787383249.053267:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640951c00 x1874206984843008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383249.053278:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984843008:0@lo:400:kworker.0 00010000:00080000:1.0:1787383249.053288:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d91a300 x1874206984843520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383249.053297:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984843520:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.053341:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984842624:0@lo:400:kworker.0 00010000:00080000:1.0:1787383249.053349:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640953b80 x1874206984843136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383249.053358:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984843136:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.053369:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984842240:0@lo:400:kworker.0 00000100:00100000:1.0:1787383249.053377:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984842752:0@lo:400:kworker.0 00010000:00080000:1.0:1787383249.053387:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d919500 x1874206984843264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383249.053396:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984843264:0@lo:400:kworker.0 00010000:00080000:1.0:1787383249.053406:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f995c00 x1874206984843776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383249.053413:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984843776:0@lo:400:kworker.0 00000100:00100000:2.0:1787383249.054261:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787383249.054281:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984843648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383249.054576:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984843648:12345-0@lo:400:kworker.0 Request processed in 303us (1837us total) trans 0 rc 0/0 00010000:00080000:0.0:1787383249.055214:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d91a680 x1874206984843648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383249.055234:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984843648:0@lo:400:kworker.0 00000100:00100000:2.0:1787383249.059488:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787383249.468223:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383249.469099:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965900672 00000100:00100000:1.0:1787383249.469131:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965900672 00000100:00100000:1.0:1787383249.469228:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 281 00000100:00100000:1.0:1787383249.469241:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2402:x1874206965900672:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383249.469351:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2402:x1874206965900672:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 112us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383249.469359:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 281 00000100:00100000:0.0:1787383249.475698:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383249.476241:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383249.476410:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965900800 00000100:00100000:1.0:1787383249.476420:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965900800 00000100:00100000:1.0:1787383249.476527:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965900928 00000100:00100000:1.0:1787383249.476531:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965900928 00000100:00080000:3.0:1787383249.476704:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787383249.476710:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383249.476947:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 99 00000100:00100000:2.0:1787383249.476959:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2402:x1874206965900800:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383249.477152:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2402:x1874206965900800:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 190us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383249.477160:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 99 00000100:00100000:2.0:1787383249.477177:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 100 00000100:00100000:2.0:1787383249.477184:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965900928:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383249.477206:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965900928:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383249.477212:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 100 00010000:00010000:0.0:1787383249.564207:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383249.564633:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984843904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383249.564684:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984844032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383249.564711:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383249.564829:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984843904 00000100:00100000:0.0:1787383249.564840:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984843904 00000100:00100000:0.0:1787383249.564908:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787383249.564918:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984843904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383249.564956:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383249.565039:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984843904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383249.565047:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787383249.565125:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d3100 x1874206984843904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383249.565149:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984843904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383249.565711:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383249.565885:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984844032 00000100:00100000:0.0:1787383249.565891:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984844032 00000100:00100000:0.0:1787383249.565935:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787383249.565943:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984844032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383249.565960:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383249.566007:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984844032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383249.566014:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787383249.566087:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cd2680 x1874206984844032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383249.566103:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984844032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383250.075671:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350338a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984844160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383250.075795:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383250.076164:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984844160 00000100:00100000:1.0:1787383250.076175:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984844160 00000100:00100000:1.0:1787383250.076251:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787383250.076265:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984844160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383250.076313:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787383250.076382:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984844160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383250.076392:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787383250.076473:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350338a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984844160:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787383250.356166:0:11365:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 03:20:48 EDT 2026 00000100:00100000:3.0:1787383250.588020:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984844288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383250.588115:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383250.588209:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984844288 00000100:00100000:3.0:1787383250.588219:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984844288 00000100:00100000:3.0:1787383250.588283:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787383250.588293:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984844288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787383250.588332:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383250.588381:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984844288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383250.588948:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787383250.589023:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503388380 x1874206984844288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383250.589066:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984844288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383250.589826:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984844416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383250.589892:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383250.590176:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984844416 00000100:00100000:3.0:1787383250.590184:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984844416 00000100:00100000:3.0:1787383250.590253:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787383250.590265:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984844416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383250.590288:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383250.590339:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984844416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383250.590347:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787383250.590404:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d0a80 x1874206984844416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383250.590423:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984844416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787383250.593963:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383251.612953:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383252.643456:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383253.147083:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383253.147116:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984844544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787383253.147232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383253.147463:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984844544 00000100:00100000:1.0:1787383253.147474:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984844544 00000100:00100000:1.0:1787383253.147666:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787383253.147678:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984844544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383253.147724:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383253.148497:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984844544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 818us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383253.148583:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984844544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787383253.148752:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:3.0:1787383253.663797:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383254.172458:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383254.172530:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383254.172559:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984844800:0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.172655:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383254.172800:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984844800 00000100:00100000:2.0:1787383254.172812:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984844800 00000100:00100000:2.0:1787383254.172886:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787383254.172897:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984844800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383254.172965:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984844800:12345-0@lo:400:kworker.0 Request processed in 70us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383254.172993:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787383254.173044:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984844800:0@lo:400:kworker.0 00000100:00100000:0.0:1787383254.174749:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984844672:0@lo:400:kworker.0 00000100:00100000:0.0:1787383254.174855:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383254.175576:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984844672 00000100:00100000:1.0:1787383254.175589:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984844672 00000100:00100000:1.0:1787383254.175664:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787383254.175675:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984844672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.175746:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984844672:12345-0@lo:400:kworker.0 Request processed in 72us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383254.175754:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787383254.177059:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984844672:0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.178162:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984845184:0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.178248:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383254.178331:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984845056:0@lo:400:kworker.0 00000100:00100000:2.0:1787383254.178380:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383254.179034:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383254.179043:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984844928:0@lo:400:kworker.0 00000100:00100000:2.0:1787383254.179078:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383254.179139:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984845056 00000100:00100000:2.0:1787383254.179149:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984845056 00000100:00100000:2.0:1787383254.179208:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787383254.179217:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984845056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383254.179275:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984845056:12345-0@lo:400:kworker.0 Request processed in 59us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383254.179283:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787383254.179336:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984845056:0@lo:400:kworker.0 00000100:00100000:0.0:1787383254.179452:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984845184 00000100:00100000:0.0:1787383254.179459:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984845184 00000100:00100000:0.0:1787383254.179487:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984844928 00000100:00100000:0.0:1787383254.179490:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984844928 00000100:00100000:0.0:1787383254.179645:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787383254.179653:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984845184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383254.180650:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984845184:12345-0@lo:400:kworker.0 Request processed in 993us (2399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383254.180676:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787383254.180703:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787383254.180710:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984844928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383254.180804:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984845312:0@lo:400:kworker.0 00000100:00100000:0.0:1787383254.180846:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984844928:12345-0@lo:400:kworker.0 Request processed in 136us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383254.180857:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787383254.180858:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383254.180888:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984845824:0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.181017:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984845184:0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.181043:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984845696:0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.181075:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383254.181102:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984846208:0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.181139:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383254.181177:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984845696 00000100:00100000:1.0:1787383254.181184:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984845696 00000100:00100000:0.0:1787383254.181238:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984846208 00000100:00100000:0.0:1787383254.181243:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984846208 00000100:00100000:1.0:1787383254.181244:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787383254.181257:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984845696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383254.181288:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787383254.181295:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984846208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.181305:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984845696:12345-0@lo:400:kworker.0 Request processed in 51us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383254.181314:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787383254.181330:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984846208:12345-0@lo:400:kworker.0 Request processed in 35us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383254.181335:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787383254.181351:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383254.181358:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787383254.181376:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f993100 x1874206984845696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383254.181385:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984845696:0@lo:400:kworker.0 00010000:00080000:0.0:1787383254.181404:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f991180 x1874206984846208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383254.181412:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984846208:0@lo:400:kworker.0 00000100:00100000:3.0:1787383254.182132:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383254.182260:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984845312 00000100:00100000:2.0:1787383254.182266:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984845312 00000100:00100000:2.0:1787383254.182320:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984845824 00000100:00100000:2.0:1787383254.182324:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984845824 00000100:00100000:0.0:1787383254.182513:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787383254.182527:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984845312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383254.182528:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787383254.182542:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984845824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383254.182590:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984845312:12345-0@lo:400:kworker.0 Request processed in 67us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383254.182599:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787383254.182602:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984845824:12345-0@lo:400:kworker.0 Request processed in 61us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383254.182658:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984845440:0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.182678:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984845568:0@lo:400:kworker.0 00000100:00100000:0.0:1787383254.182698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383254.182721:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383254.182728:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984845952:0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.182748:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984846080:0@lo:400:kworker.0 00000100:00080000:3.0:1787383254.182795:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383254.184057:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787383254.184095:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984845440 00000100:00100000:2.0:1787383254.184151:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984845440 00000100:00100000:2.0:1787383254.184211:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787383254.184221:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984845440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.185941:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383254.186042:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984844928:0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.186110:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984845568 00000100:00100000:1.0:1787383254.186117:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984845568 00000100:00100000:1.0:1787383254.186170:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984846080 00000100:00100000:1.0:1787383254.186173:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984846080 00000100:00100000:1.0:1787383254.186200:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787383254.186209:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984845568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.186272:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984845568:12345-0@lo:400:kworker.0 Request processed in 64us (3551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383254.186281:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787383254.186299:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787383254.186305:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984846080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.186377:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984846080:12345-0@lo:400:kworker.0 Request processed in 64us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383254.186384:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787383254.186681:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503389500 x1874206984845568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383254.186694:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984845568:0@lo:400:kworker.0 00010000:00080000:1.0:1787383254.186708:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f992a00 x1874206984846080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383254.186716:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984846080:0@lo:400:kworker.0 00000100:00080000:1.0:1787383254.192800:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383254.192817:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383254.192823:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383254.193213:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984845312:0@lo:400:kworker.0 00000100:00100000:3.0:1787383254.193235:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984845824:0@lo:400:kworker.0 00000100:00100000:0.0:1787383254.193419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383254.193673:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984845952 00000100:00100000:1.0:1787383254.193682:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984845952 00000100:00100000:2.0:1787383254.193859:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984845440:12345-0@lo:400:kworker.0 Request processed in 9636us (11156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383254.193872:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787383254.193965:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383254.194184:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787383254.194197:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984845952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383254.194279:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984845952:12345-0@lo:400:kworker.0 Request processed in 85us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383254.194287:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:1.0:1787383254.194338:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503389880 x1874206984845440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383254.194352:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984845440:0@lo:400:kworker.0 00010000:00080000:1.0:1787383254.194364:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f991f80 x1874206984845952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383254.194372:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984845952:0@lo:400:kworker.0 00000100:00100000:3.0:1787383254.580651:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383254.580795:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383254.580829:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383254.580944:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965901056 00000100:00100000:2.0:1787383254.580968:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965901056 00000100:00100000:2.0:1787383254.581060:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 283 00000100:00100000:2.0:1787383254.581073:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2403:x1874206965901056:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383254.581200:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2403:x1874206965901056:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 129us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383254.581211:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 283 00000100:00100000:2.0:1787383254.596313:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965901312 00000100:00100000:2.0:1787383254.596331:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965901312 00000100:00080000:3.0:1787383254.596487:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383254.596844:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 107 00000100:00100000:2.0:1787383254.596860:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965901312:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383254.596956:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965901312:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 100us (16125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383254.596964:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 107 00000100:00100000:1.0:1787383254.597858:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965901184 00000100:00100000:1.0:1787383254.597868:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965901184 00000100:00080000:3.0:1787383254.601720:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383254.602105:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 108 00000100:00100000:2.0:1787383254.602122:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965901184:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383254.602207:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965901184:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 90us (21564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383254.602214:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 108 00000100:00100000:0.0:1787383254.683062:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383254.683097:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984846336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383254.683189:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383254.683261:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383254.683278:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984846336 00000100:00100000:0.0:1787383254.683289:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984846336 00000100:00100000:0.0:1787383254.683349:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787383254.683360:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984846336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383254.683399:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383254.683461:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984846336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383254.683470:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787383254.683520:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503026680 x1874206984846336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383254.683541:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984846336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383254.691443:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787383254.691475:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984846464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383254.691567:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383254.691810:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984846464 00000100:00100000:0.0:1787383254.691821:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984846464 00000100:00100000:0.0:1787383254.691881:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787383254.691891:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984846464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383254.692009:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383254.692064:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984846464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 174us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383254.692073:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1787383254.692129:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503026680 x1874206984846464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383254.692151:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984846464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383255.201408:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984846592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383255.201516:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383255.201653:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984846592 00000100:00100000:2.0:1787383255.201663:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984846592 00000100:00100000:2.0:1787383255.201734:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787383255.201744:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984846592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383255.201807:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787383255.213670:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984846592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 11916us (12142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383255.213689:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787383255.213920:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984846592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383255.707707:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984846720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383255.707839:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383255.707929:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984846720 00000100:00100000:3.0:1787383255.707939:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984846720 00000100:00100000:3.0:1787383255.707994:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787383255.708004:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984846720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787383255.708040:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383255.708103:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984846720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383255.708112:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787383255.708355:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f992a00 x1874206984846720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383255.708376:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984846720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383255.708530:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383255.708540:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984846848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383255.708574:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383255.708604:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984846848 00000100:00100000:2.0:1787383255.708609:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984846848 00000100:00100000:2.0:1787383255.708636:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787383255.708643:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984846848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383255.708655:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383255.708685:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984846848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383255.708691:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787383255.708718:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d1500 x1874206984846848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383255.708731:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984846848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787383255.711271:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383256.741616:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383257.756057:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383258.270153:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383258.270188:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984846976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787383258.270280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383258.270371:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984846976 00000100:00100000:1.0:1787383258.270381:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984846976 00000100:00100000:1.0:1787383258.270464:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787383258.270475:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984846976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383258.270520:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383258.270572:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984846976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383258.270580:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787383258.270641:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984846976:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787383258.781082:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383259.292122:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984847232:0@lo:400:kworker.0 00000100:00100000:1.0:1787383259.292210:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984847360:0@lo:400:kworker.0 00000100:00100000:0.0:1787383259.292227:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383259.292250:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383259.292326:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984847104:0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.292380:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383259.292463:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984847872:0@lo:400:kworker.0 00000100:00100000:1.0:1787383259.292490:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383259.293912:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984847488:0@lo:400:kworker.0 00000100:00100000:3.0:1787383259.293984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383259.294087:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984847232 00000100:00100000:2.0:1787383259.294098:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984847232 00000100:00100000:2.0:1787383259.294186:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984847872 00000100:00100000:2.0:1787383259.294192:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984847872 00000100:00100000:2.0:1787383259.294222:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984847488 00000100:00100000:2.0:1787383259.294226:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984847488 00000100:00100000:2.0:1787383259.294242:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787383259.294251:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984847232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.294329:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984847232:12345-0@lo:400:kworker.0 Request processed in 77us (2101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383259.294607:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787383259.294631:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787383259.294639:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984847872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.294679:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984847872:12345-0@lo:400:kworker.0 Request processed in 42us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383259.294685:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787383259.294697:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787383259.294703:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984847488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.294730:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984847488:12345-0@lo:400:kworker.0 Request processed in 28us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383259.294736:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787383259.294784:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984847104 00000100:00100000:2.0:1787383259.294788:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984847104 00000100:00100000:2.0:1787383259.294821:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787383259.294828:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984847104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.294861:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984847104:12345-0@lo:400:kworker.0 Request processed in 33us (2481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383259.294868:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:2.0:1787383259.294910:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787383259.295029:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503024e00 x1874206984847872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383259.295046:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984847872:0@lo:400:kworker.0 00000100:00100000:1.0:1787383259.295056:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984848384:0@lo:400:kworker.0 00000100:00100000:1.0:1787383259.295086:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383259.295141:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984847104:0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.295149:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984847616:0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.295179:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383259.295204:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984848128:0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.295230:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383259.295252:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984848640:0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.295279:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383259.295595:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984847360 00000100:00100000:2.0:1787383259.295602:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984847360 00000100:00100000:2.0:1787383259.295630:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984847616 00000100:00100000:2.0:1787383259.295633:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984847616 00000100:00100000:2.0:1787383259.295648:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787383259.295654:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984847360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.295699:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984847360:12345-0@lo:400:kworker.0 Request processed in 45us (3448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383259.295706:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787383259.295721:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787383259.295726:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984847616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.295757:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984847616:12345-0@lo:400:kworker.0 Request processed in 30us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383259.295763:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787383259.295806:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984848128 00000100:00100000:2.0:1787383259.295810:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984848128 00000100:00100000:2.0:1787383259.295844:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984848640 00000100:00100000:2.0:1787383259.295847:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984848640 00000100:00100000:2.0:1787383259.295870:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787383259.295876:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984848128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.295920:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984848128:12345-0@lo:400:kworker.0 Request processed in 44us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383259.295927:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787383259.295938:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787383259.295944:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984848640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.295971:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984848640:12345-0@lo:400:kworker.0 Request processed in 27us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383259.295977:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787383259.295997:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383259.296001:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383259.296029:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984847616:0@lo:400:kworker.0 00010000:00080000:2.0:1787383259.296041:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503026d80 x1874206984848128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383259.296050:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984848128:0@lo:400:kworker.0 00010000:00080000:2.0:1787383259.296059:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503026a00 x1874206984848640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383259.296066:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984848640:0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.296091:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984848384 00000100:00100000:2.0:1787383259.296094:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984848384 00000100:00100000:2.0:1787383259.296124:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787383259.296130:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984848384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.296161:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984848384:12345-0@lo:400:kworker.0 Request processed in 31us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383259.296168:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1787383259.296189:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383259.296384:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984847232:0@lo:400:kworker.0 00000100:00100000:0.0:1787383259.296394:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984847744:0@lo:400:kworker.0 00000100:00100000:0.0:1787383259.296436:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383259.296460:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984848256:0@lo:400:kworker.0 00000100:00100000:0.0:1787383259.296480:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383259.296517:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984847744 00000100:00100000:0.0:1787383259.296521:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984847744 00000100:00100000:0.0:1787383259.296549:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984848256 00000100:00100000:0.0:1787383259.296552:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984848256 00000100:00100000:0.0:1787383259.296570:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787383259.296576:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984847744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383259.296617:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984847744:12345-0@lo:400:kworker.0 Request processed in 41us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383259.296624:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787383259.296635:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787383259.296640:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984848256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383259.296664:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984848256:12345-0@lo:400:kworker.0 Request processed in 24us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383259.296670:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1787383259.296682:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383259.296701:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984847744:0@lo:400:kworker.0 00000100:00100000:0.0:1787383259.296710:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984848256:0@lo:400:kworker.0 00000100:00100000:3.0:1787383259.299081:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984847488:0@lo:400:kworker.0 00000100:00100000:3.0:1787383259.299101:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984848000:0@lo:400:kworker.0 00000100:00100000:3.0:1787383259.299180:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383259.299294:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984848512:0@lo:400:kworker.0 00000100:00100000:3.0:1787383259.299322:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787383259.300627:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503024700 x1874206984848384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383259.300670:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984848384:0@lo:400:kworker.0 00000100:00100000:1.0:1787383259.300723:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984847360:0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.312823:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984848000 00000100:00100000:2.0:1787383259.312846:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984848000 00000100:00100000:2.0:1787383259.312978:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984848512 00000100:00100000:2.0:1787383259.312983:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984848512 00000100:00100000:2.0:1787383259.313018:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787383259.313030:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f993100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984848000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.313167:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f993100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984848000:12345-0@lo:400:kworker.0 Request processed in 138us (13987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383259.313175:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787383259.313194:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787383259.313200:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984848512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383259.313231:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984848512:12345-0@lo:400:kworker.0 Request processed in 31us (13908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383259.313237:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1787383259.313318:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503025180 x1874206984848000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383259.313336:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984848000:0@lo:400:kworker.0 00010000:00080000:2.0:1787383259.313350:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503025880 x1874206984848512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383259.313358:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984848512:0@lo:400:kworker.0 00000100:00080000:1.0:1787383259.313630:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383259.313637:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383259.708155:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383259.708327:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383259.708433:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383259.708519:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965901440 00000100:00100000:2.0:1787383259.708533:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965901440 00000100:00100000:2.0:1787383259.708600:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 285 00000100:00100000:2.0:1787383259.708623:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2403:x1874206965901440:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383259.708698:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965901696 00000100:00100000:3.0:1787383259.708703:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965901696 00000100:00100000:2.0:1787383259.708715:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2403:x1874206965901440:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 106us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383259.708729:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 285 00000100:00100000:3.0:1787383259.708754:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965901568 00000100:00100000:3.0:1787383259.708757:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965901568 00000100:00080000:2.0:1787383259.708934:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383259.708940:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383259.709431:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:0.0:1787383259.709452:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965901696:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383259.709514:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965901696:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 75us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383259.709521:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:0.0:1787383259.709537:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:0.0:1787383259.709543:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965901568:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383259.709780:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965901568:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 219us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383259.709789:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:0.0:1787383259.803817:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984848768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383259.803913:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383259.803997:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383259.804014:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984848768 00000100:00100000:0.0:1787383259.804022:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984848768 00000100:00100000:0.0:1787383259.804078:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787383259.804088:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984848768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383259.804125:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383259.804174:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984848768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383259.804182:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787383259.804238:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503025f80 x1874206984848768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383259.804258:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984848768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383259.804661:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984848896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383259.804700:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383259.804738:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984848896 00000100:00100000:1.0:1787383259.804743:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984848896 00000100:00100000:1.0:1787383259.804789:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787383259.804796:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984848896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383259.804810:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383259.804842:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984848896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383259.804849:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787383259.804879:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d918000 x1874206984848896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383259.804894:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984848896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383260.317435:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984849024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383260.317537:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383260.317647:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984849024 00000100:00100000:2.0:1787383260.317657:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984849024 00000100:00100000:2.0:1787383260.317919:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787383260.317931:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984849024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383260.317978:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787383260.318041:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984849024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383260.318049:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787383260.318202:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984849024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383260.831562:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984849152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383260.831658:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383260.831756:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984849152 00000100:00100000:1.0:1787383260.831786:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984849152 00000100:00100000:1.0:1787383260.831844:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787383260.831854:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984849152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383260.831892:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383260.831950:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984849152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383260.831959:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787383260.832012:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640951c00 x1874206984849152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383260.832036:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984849152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383260.832202:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383260.832212:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984849280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383260.832242:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383260.832270:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984849280 00000100:00100000:1.0:1787383260.832275:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984849280 00000100:00100000:1.0:1787383260.832295:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787383260.832301:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984849280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383260.832312:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383260.832339:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984849280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383260.832344:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1787383260.832370:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640951c00 x1874206984849280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383260.832382:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984849280:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787383260.834035:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383261.851983:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383262.881834:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383263.387306:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984849408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383263.387423:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383263.387592:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984849408 00000100:00100000:2.0:1787383263.387604:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984849408 00000100:00100000:2.0:1787383263.387686:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787383263.387698:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984849408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787383263.387747:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787383263.387835:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984849408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383263.387844:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787383263.388031:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984849408:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787383263.902218:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383264.412116:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984849664:0@lo:400:kworker.0 00000100:00100000:2.0:1787383264.412219:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984849920:0@lo:400:kworker.0 00000100:00100000:3.0:1787383264.412226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383264.412301:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984849792:0@lo:400:kworker.0 00000100:00100000:1.0:1787383264.412373:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984849536:0@lo:400:kworker.0 00000100:00100000:2.0:1787383264.412424:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383264.412477:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984850432:0@lo:400:kworker.0 00000100:00100000:2.0:1787383264.412504:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383264.412540:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984850944:0@lo:400:kworker.0 00000100:00100000:2.0:1787383264.412563:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383264.412612:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984850432 00000100:00100000:2.0:1787383264.412622:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984850432 00000100:00100000:2.0:1787383264.412679:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984850944 00000100:00100000:2.0:1787383264.412682:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984850944 00000100:00100000:2.0:1787383264.412707:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787383264.412718:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984850432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383264.412800:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984850432:12345-0@lo:400:kworker.0 Request processed in 84us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383264.412808:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787383264.412826:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787383264.412832:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984850944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383264.412861:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984850944:12345-0@lo:400:kworker.0 Request processed in 29us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383264.412868:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1787383264.412890:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383264.412895:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787383264.412930:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503776d80 x1874206984850432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383264.412946:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984850432:0@lo:400:kworker.0 00010000:00080000:2.0:1787383264.412959:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503776a00 x1874206984850944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383264.412966:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984850944:0@lo:400:kworker.0 00000100:00100000:2.0:1787383264.413013:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984849664 00000100:00100000:2.0:1787383264.413017:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984849664 00000100:00100000:2.0:1787383264.413052:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984849920 00000100:00100000:2.0:1787383264.413056:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984849920 00000100:00100000:2.0:1787383264.413074:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787383264.413080:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984849664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383264.413114:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984849664:12345-0@lo:400:kworker.0 Request processed in 34us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383264.413120:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787383264.413132:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787383264.413138:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984849920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383264.413171:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984849920:12345-0@lo:400:kworker.0 Request processed in 32us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383264.413177:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787383264.413207:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984849920:0@lo:400:kworker.0 00000100:00100000:3.0:1787383264.414704:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984849664:0@lo:400:kworker.0 00000100:00100000:3.0:1787383264.414749:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984850176:0@lo:400:kworker.0 00000100:00100000:3.0:1787383264.414827:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383264.415026:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984850688:0@lo:400:kworker.0 00000100:00100000:3.0:1787383264.415054:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383264.415154:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984850176 00000100:00100000:2.0:1787383264.415160:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984850176 00000100:00100000:2.0:1787383264.415327:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984850688 00000100:00100000:2.0:1787383264.415331:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984850688 00000100:00100000:3.0:1787383264.415412:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787383264.415434:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984850176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383264.415496:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984850176:12345-0@lo:400:kworker.0 Request processed in 74us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383264.415504:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787383264.415524:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787383264.415531:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984850688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383264.415561:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984850688:12345-0@lo:400:kworker.0 Request processed in 30us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383264.415567:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787383264.416150:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383264.417036:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984850176:0@lo:400:kworker.0 00000100:00100000:0.0:1787383264.417037:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383264.417059:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503774700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984850688:0@lo:400:kworker.0 00000100:00100000:0.0:1787383264.417088:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984850304:0@lo:400:kworker.0 00000100:00100000:0.0:1787383264.417128:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383264.417133:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984849792 00000100:00100000:2.0:1787383264.417140:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984849792 00000100:00100000:0.0:1787383264.417170:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984850816:0@lo:400:kworker.0 00000100:00100000:2.0:1787383264.417192:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787383264.417202:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383264.417206:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984849792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383264.417246:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984850304 00000100:00100000:0.0:1787383264.417251:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984850304 00000100:00100000:2.0:1787383264.417275:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984849792:12345-0@lo:400:kworker.0 Request processed in 73us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383264.417288:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984850816 00000100:00100000:0.0:1787383264.417293:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984850816 00000100:00100000:2.0:1787383264.417305:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787383264.417316:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787383264.417325:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984850304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383264.417372:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984850304:12345-0@lo:400:kworker.0 Request processed in 39us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383264.417379:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787383264.417394:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787383264.417400:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984850816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383264.417426:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984850816:12345-0@lo:400:kworker.0 Request processed in 26us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383264.417431:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1787383264.417462:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383264.417466:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984849792:0@lo:400:kworker.0 00010000:00080000:0.0:1787383264.417484:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503775180 x1874206984850304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383264.417495:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984850304:0@lo:400:kworker.0 00010000:00080000:0.0:1787383264.417505:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503775880 x1874206984850816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383264.417514:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984850816:0@lo:400:kworker.0 00000100:00100000:1.0:1787383264.418385:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383264.418440:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984850048:0@lo:400:kworker.0 00000100:00100000:1.0:1787383264.418474:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383264.418490:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984850560:0@lo:400:kworker.0 00000100:00100000:1.0:1787383264.418530:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383264.418565:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984851072:0@lo:400:kworker.0 00000100:00100000:1.0:1787383264.418589:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383264.418635:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984850560 00000100:00100000:1.0:1787383264.418641:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984850560 00000100:00100000:1.0:1787383264.418690:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984851072 00000100:00100000:1.0:1787383264.418693:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984851072 00000100:00100000:1.0:1787383264.418717:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787383264.418725:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984850560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383264.418792:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984850560:12345-0@lo:400:kworker.0 Request processed in 67us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383264.418799:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787383264.418815:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787383264.418821:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984851072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383264.418847:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984851072:12345-0@lo:400:kworker.0 Request processed in 26us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383264.418853:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1787383264.418894:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503777800 x1874206984850560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383264.419009:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984850048 00000100:00100000:0.0:1787383264.419014:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984850048 00000100:00100000:0.0:1787383264.419059:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787383264.419066:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984850048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383264.419105:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984850048:12345-0@lo:400:kworker.0 Request processed in 40us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383264.419112:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787383264.419132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984849536 00000100:00100000:2.0:1787383264.419138:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984849536 00000100:00100000:2.0:1787383264.419172:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787383264.419181:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984849536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383264.419222:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984849536:12345-0@lo:400:kworker.0 Request processed in 44us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383264.419229:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787383264.419283:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984850560:0@lo:400:kworker.0 00010000:00080000:1.0:1787383264.419301:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503776300 x1874206984851072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383264.419311:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984851072:0@lo:400:kworker.0 00000100:00100000:1.0:1787383264.419337:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984849536:0@lo:400:kworker.0 00000100:00100000:1.0:1787383264.419346:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984850048:0@lo:400:kworker.0 00000100:00080000:3.0:1787383264.419443:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383264.419448:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383264.824196:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383264.824257:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383264.824368:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383264.824608:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965901952 00000100:00100000:2.0:1787383264.824620:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965901952 00000100:00100000:2.0:1787383264.824710:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965902080 00000100:00100000:2.0:1787383264.824713:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965902080 00000100:00100000:2.0:1787383264.824744:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:2.0:1787383264.824755:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965901952:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383264.824895:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965901952:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 141us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383264.824904:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:2.0:1787383264.824926:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:2.0:1787383264.824933:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965902080:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383264.824959:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965902080:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 28us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383264.824966:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00080000:0.0:1787383264.825519:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383264.825526:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383264.825658:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965901824 00000100:00100000:3.0:1787383264.825666:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965901824 00000100:00100000:3.0:1787383264.825835:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 287 00000100:00100000:3.0:1787383264.825845:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2403:x1874206965901824:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383264.825909:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2403:x1874206965901824:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 66us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383264.825915:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 287 00010000:00010000:0.0:1787383264.923087:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383264.923446:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984851200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383264.923536:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383264.923826:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984851200 00000100:00100000:1.0:1787383264.923836:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984851200 00000100:00100000:1.0:1787383264.923890:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787383264.923901:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984851200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787383264.923942:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383264.924003:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984851200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383264.924011:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787383264.924057:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503027480 x1874206984851200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383264.924078:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984851200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383264.924501:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984851328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383264.924544:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383264.925067:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984851328 00000100:00100000:2.0:1787383264.925090:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984851328 00000100:00100000:2.0:1787383264.925142:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787383264.925151:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984851328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383264.925171:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383264.925238:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984851328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383264.925245:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787383264.925470:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503774e00 x1874206984851328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383264.927670:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984851328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383265.436373:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984851456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383265.436475:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383265.437151:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984851456 00000100:00100000:0.0:1787383265.437236:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984851456 00000100:00100000:0.0:1787383265.437316:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787383265.437327:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984851456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383265.437380:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787383265.437517:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984851456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383265.437525:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787383265.441399:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984851456:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787383265.947493:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383265.948135:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984851712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383265.948224:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383265.948292:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984851584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383265.948316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383265.948406:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984851712 00000100:00100000:3.0:1787383265.948415:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984851712 00000100:00100000:3.0:1787383265.948469:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984851584 00000100:00100000:3.0:1787383265.948471:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984851584 00000100:00100000:3.0:1787383265.948486:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787383265.948494:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984851712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383265.948529:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383265.948583:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984851712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383265.948591:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787383265.948608:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787383265.948614:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984851584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787383265.948623:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383265.948640:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984851584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383265.948646:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787383265.948762:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503775500 x1874206984851712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383265.948812:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984851712:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787383265.948823:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3ea00 x1874206984851584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383265.948850:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984851584:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1787383266.526259:0:11995:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 03:21:05 (1787383265) === 00000100:00100000:0.0:1787383266.952117:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383266.953411:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965902208 00000100:00100000:2.0:1787383266.953870:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965902208 00000100:00100000:3.0:1787383266.954038:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 288 00000100:00100000:3.0:1787383266.954068:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:8735:x1874206965902208:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787383266.954091:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383266.954116:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963601654000/0xc40acec91532e590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402607 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383266.954157:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963601654000/0xc40acec91532e590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402607 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383266.954170:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963601654000/0xc40acec91532e590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402607 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383266.954181:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601654000, rc 0) 00000100:00100000:3.0:1787383266.954394:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:8735:x1874206965902208:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 328us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383266.954403:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 288 00000100:00100000:1.0:1787383266.961714:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383266.964252:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965902336 00000100:00100000:3.0:1787383266.964266:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965902336 00000100:00100000:3.0:1787383266.964358:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 289 00000100:00100000:3.0:1787383266.964369:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96361a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:8735:x1874206965902336:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787383266.964543:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96361a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:8735:x1874206965902336:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 175us (2836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383266.964551:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 289 00000100:00100000:2.0:1787383266.970588:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383266.972527:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965902464 00000100:00100000:0.0:1787383266.972571:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965902464 00000100:00100000:0.0:1787383266.972643:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 290 00000100:00100000:0.0:1787383266.972654:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:8735:x1874206965902464:12345-192.168.203.2@tcp:503:mount.lustre.0 00010000:00010000:3.0:1787383266.972930:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383266.975301:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:8735:x1874206965902464:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 2633us (4720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383266.975321:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 290 00000100:00100000:0.0:1787383266.988726:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383266.989114:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965902592 00000100:00100000:3.0:1787383266.989128:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965902592 00000100:00100000:3.0:1787383266.989295:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 291 00000100:00100000:3.0:1787383266.989308:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:8739:x1874206965902592:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787383266.989525:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:8739:x1874206965902592:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 220us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383266.989535:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 291 00000100:00100000:1.0:1787383267.027832:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.028058:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965902720 00000100:00100000:2.0:1787383267.028071:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965902720 00000100:00100000:2.0:1787383267.028148:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 292 00000100:00100000:2.0:1787383267.028160:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:8739:x1874206965902720:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787383267.029702:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:8739:x1874206965902720:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 1037us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.029720:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 292 00000100:00100000:2.0:1787383267.043552:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383267.046087:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965902848 00000100:00100000:3.0:1787383267.046109:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965902848 00000100:00100000:3.0:1787383267.046511:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 293 00000100:00100000:3.0:1787383267.046526:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:8739:x1874206965902848:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787383267.046758:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:8739:x1874206965902848:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 236us (3218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383267.046813:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 293 00000100:00100000:0.0:1787383267.065891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.066006:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965902976 00000100:00100000:2.0:1787383267.066019:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965902976 00000100:00100000:2.0:1787383267.066089:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 294 00000100:00100000:2.0:1787383267.066101:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:8735:x1874206965902976:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787383267.066133:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383267.066159:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b6400/0xc40acec91532e597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402638 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383267.066228:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b6400/0xc40acec91532e597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402638 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383267.066242:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b6400/0xc40acec91532e597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402638 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383267.066254:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b6400, rc 0) 00000100:00100000:2.0:1787383267.066496:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:8735:x1874206965902976:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 396us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.066504:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 294 00000100:00100000:1.0:1787383267.074709:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383267.075508:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965903104 00000100:00100000:3.0:1787383267.075525:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965903104 00000100:00100000:2.0:1787383267.075802:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 295 00000100:00100000:2.0:1787383267.075818:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:8735:x1874206965903104:12345-192.168.203.2@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787383267.075854:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787383267.075977:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787383267.075983:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787383267.075988:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787383267.075992:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787383267.075994:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787383267.079314:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:8735:x1874206965903104:12345-192.168.203.2@tcp:256:mount.lustre.0 Request processed in 3484us (4603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.079350:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 295 00000100:00100000:0.0:1787383267.087830:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.087942:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965903232 00000100:00100000:2.0:1787383267.087956:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965903232 00000100:00100000:2.0:1787383267.088032:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 296 00000100:00100000:2.0:1787383267.088045:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:8735:x1874206965903232:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787383267.088068:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383267.088243:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b7e00/0xc40acec91532e59e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340263f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383267.088287:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b7e00/0xc40acec91532e59e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340263f expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383267.088300:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b7e00/0xc40acec91532e59e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340263f expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383267.088312:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b7e00, rc 0) 00000100:00100000:2.0:1787383267.088434:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:8735:x1874206965903232:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 390us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.088443:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 296 00000100:00100000:1.0:1787383267.114665:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.121625:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965903360 00000100:00100000:2.0:1787383267.121648:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965903360 00000100:00100000:2.0:1787383267.123022:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 297 00000100:00100000:2.0:1787383267.123047:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:8735:x1874206965903360:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787383267.123273:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:8735:x1874206965903360:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 236us (8622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.123283:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 297 00000100:00100000:3.0:1787383267.128147:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.129621:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965903488 00000100:00100000:2.0:1787383267.129641:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965903488 00000100:00100000:2.0:1787383267.130129:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 298 00000100:00100000:2.0:1787383267.130146:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:8735:x1874206965903488:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787383267.130643:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:8735:x1874206965903488:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 500us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.130655:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 298 00000100:00100000:0.0:1787383267.142560:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383267.149198:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965903616 00000100:00100000:3.0:1787383267.149214:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965903616 00000100:00100000:3.0:1787383267.149368:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 299 00000100:00100000:3.0:1787383267.149379:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:8745:x1874206965903616:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787383267.150540:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:8745:x1874206965903616:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 1157us (7982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383267.150552:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 299 00000100:00100000:0.0:1787383267.153995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.154094:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965903744 00000100:00100000:2.0:1787383267.154103:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965903744 00000100:00100000:2.0:1787383267.154156:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 300 00000100:00100000:2.0:1787383267.154166:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:8745:x1874206965903744:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787383267.154322:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:8745:x1874206965903744:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 157us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.154330:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 300 00000100:00100000:2.0:1787383267.180870:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.180922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.180951:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.180991:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.181024:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965903872 00000100:00100000:2.0:1787383267.181033:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965903872 00000100:00100000:2.0:1787383267.181066:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965904384 00000100:00100000:2.0:1787383267.181069:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965904384 00000100:00100000:2.0:1787383267.181077:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965904000 00000100:00100000:2.0:1787383267.181079:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965904000 00000100:00100000:2.0:1787383267.181108:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965904128 00000100:00100000:2.0:1787383267.181111:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965904128 00000100:00100000:2.0:1787383267.181127:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00100000:2.0:1787383267.181137:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965904000:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383267.181211:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383267.181214:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965904000:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 76us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383267.181232:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1874206965903872:12345-192.168.203.2@tcp:38:mount.lustre.0 00000100:00100000:2.0:1787383267.181232:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00100000:2.0:1787383267.181262:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:2.0:1787383267.181276:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965904128:12345-192.168.203.2@tcp:400:kworker.0 00010000:00080000:3.0:1787383267.181295:0:9499:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from f43e303e-1cf9-4e4a-9e69-93ff23e31c78@192.168.203.2@tcp t0 exp 0000000000000000 cur 300 last 0 00000100:00100000:2.0:1787383267.181308:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965904128:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 35us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.181334:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:2.0:1787383267.181364:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000020:00000080:3.0:1787383267.181370:0:9499:0:(genops.c:1406:class_connect()) connect: client f43e303e-1cf9-4e4a-9e69-93ff23e31c78, cookie 0xc40acec91532e5a5 00000100:00100000:2.0:1787383267.181371:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2400:x1874206965904384:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787383267.181407:0:10098:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from f43e303e-1cf9-4e4a-9e69-93ff23e31c78@192.168.203.2@tcp t0 exp 0000000000000000 cur 300 last 0 00000004:00100000:3.0:1787383267.181417:0:9499:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:00000080:2.0:1787383267.181445:0:10098:0:(genops.c:1406:class_connect()) connect: client f43e303e-1cf9-4e4a-9e69-93ff23e31c78, cookie 0xc40acec91532e5ac 00000004:00100000:2.0:1787383267.181475:0:10098:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787383267.181597:0:9499:0:(import.c:65:import_set_state_nolock()) ffff96363f936800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787383267.181600:0:10098:0:(import.c:65:import_set_state_nolock()) ffff9635034f0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383267.181644:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2400:x1874206965904384:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 270us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.181654:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:3.0:1787383267.181679:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2400:x1874206965903872:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 450us (816us total) trans 0 rc 0/0 00000100:00080000:2.0:1787383267.181680:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383267.181690:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383267.181697:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:3.0:1787383267.193583:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383267.193719:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.194335:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965904256 00000100:00100000:2.0:1787383267.194356:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965904256 00000100:00080000:0.0:1787383267.194597:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383267.194666:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965904640 00000100:00100000:0.0:1787383267.194670:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965904640 00000100:00100000:0.0:1787383267.194840:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1787383267.194855:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+7:0:x1874206965904256:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787383267.194909:0:10098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787383267.195022:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+7:0:x1874206965904256:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 170us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.195243:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:2.0:1787383267.195254:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+7:8735:x1874206965904640:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787383267.195271:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787383267.195301:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+7:8735:x1874206965904640:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 50us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.195309:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:2.0:1787383267.195621:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.196228:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965904512 00000100:00100000:2.0:1787383267.196239:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965904512 00000100:00100000:2.0:1787383267.196296:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:2.0:1787383267.196303:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:0:x1874206965904512:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787383267.196355:0:9499:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787383267.196629:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:0:x1874206965904512:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 325us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383267.196637:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00080000:2.0:1787383267.196853:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383267.200832:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383267.200959:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965904768 00000100:00100000:3.0:1787383267.200971:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965904768 00000100:00100000:3.0:1787383267.201134:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1787383267.201146:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+7:8735:x1874206965904768:12345-192.168.203.2@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787383267.201254:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+7:8735:x1874206965904768:12345-192.168.203.2@tcp:40:mount.lustre.0 Request processed in 110us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383267.201263:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:0.0:1787383267.203062:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:2.0:1787383267.204864:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.204912:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383267.204956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383267.205047:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965904896 00000100:00100000:1.0:1787383267.205061:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965904896 00000100:00100000:1.0:1787383267.205100:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965905024 00000100:00100000:1.0:1787383267.205103:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965905024 00000100:00100000:1.0:1787383267.205125:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:1.0:1787383267.205134:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1874206965904896:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787383267.205179:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from f43e303e-1cf9-4e4a-9e69-93ff23e31c78@192.168.203.2@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:1.0:1787383267.205219:0:8436:0:(genops.c:1406:class_connect()) connect: client f43e303e-1cf9-4e4a-9e69-93ff23e31c78, cookie 0xc40acec91532e5b3 00002000:00100000:1.0:1787383267.205234:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f43e303e-1cf9-4e4a-9e69-93ff23e31c78/ffff96363f98e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787383267.205257:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787383267.205369:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1787383267.205814:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1787383267.205822:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2400:x1874206965905024:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787383267.205846:0:8914:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from f43e303e-1cf9-4e4a-9e69-93ff23e31c78@192.168.203.2@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:3.0:1787383267.205869:0:8914:0:(genops.c:1406:class_connect()) connect: client f43e303e-1cf9-4e4a-9e69-93ff23e31c78, cookie 0xc40acec91532e5ba 00002000:00100000:3.0:1787383267.205876:0:8914:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f43e303e-1cf9-4e4a-9e69-93ff23e31c78/ffff96363f937000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787383267.205889:0:8914:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787383267.206087:0:8436:0:(import.c:65:import_set_state_nolock()) ffff96363f98c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383267.206175:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503775500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2400:x1874206965904896:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 1040us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383267.206183:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:0.0:1787383267.206391:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965905152 00000100:00100000:0.0:1787383267.206398:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965905152 00000100:00100000:0.0:1787383267.206544:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:0.0:1787383267.206553:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:8735:x1874206965905152:12345-192.168.203.2@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787383267.206598:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:8735:x1874206965905152:12345-192.168.203.2@tcp:900:mount.lustre.0 Request processed in 47us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383267.206624:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00002000:00080000:3.0:1787383267.206993:0:8914:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787383267.207022:0:8914:0:(import.c:65:import_set_state_nolock()) ffff96363f930000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383267.207052:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2400:x1874206965905024:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 1229us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383267.207060:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:2.0:1787383267.210819:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383267.210918:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965905280 00000100:00100000:0.0:1787383267.210931:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965905280 00000100:00100000:0.0:1787383267.211061:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:0.0:1787383267.211074:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:8735:x1874206965905280:12345-192.168.203.2@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787383267.211209:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787383267.211317:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:8735:x1874206965905280:12345-192.168.203.2@tcp:33:mount.lustre.0 Request processed in 246us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383267.211326:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00010000:00010000:1.0:1787383267.998398:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383268.507078:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984851840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787383268.507172:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383268.507348:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984851840 00000100:00100000:0.0:1787383268.507359:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984851840 00000100:00100000:0.0:1787383268.507432:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787383268.507443:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984851840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383268.507487:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787383268.507548:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984851840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383268.507557:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787383268.507614:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984851840:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787383269.021610:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383269.533972:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984852096:0@lo:400:kworker.0 00000100:00100000:2.0:1787383269.534059:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984852352:0@lo:400:kworker.0 00000100:00100000:3.0:1787383269.534068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383269.536547:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984851968:0@lo:400:kworker.0 00000100:00100000:2.0:1787383269.537197:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383269.537281:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984852864:0@lo:400:kworker.0 00000100:00100000:2.0:1787383269.537322:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383269.537358:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984853376:0@lo:400:kworker.0 00000100:00100000:2.0:1787383269.537383:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383269.537421:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787383269.537429:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984852224:0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.537666:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383269.537698:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984852480:0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.537725:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383269.537748:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984852992:0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.537787:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383269.537806:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984853504:0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.537826:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383269.538012:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383269.538032:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984852736:0@lo:400:kworker.0 00000100:00100000:2.0:1787383269.538057:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383269.538075:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984853248:0@lo:400:kworker.0 00000100:00100000:2.0:1787383269.538097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383269.538141:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984852096 00000100:00100000:2.0:1787383269.538150:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984852096 00000100:00100000:2.0:1787383269.538219:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984852352 00000100:00100000:2.0:1787383269.538223:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984852352 00000100:00100000:2.0:1787383269.538235:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984852736 00000100:00100000:2.0:1787383269.538237:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984852736 00000100:00100000:2.0:1787383269.538259:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984853248 00000100:00100000:2.0:1787383269.538262:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984853248 00000100:00100000:2.0:1787383269.538279:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787383269.538286:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984852096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383269.538358:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984852096:12345-0@lo:400:kworker.0 Request processed in 72us (4289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383269.538366:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787383269.538385:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787383269.538391:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984852352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383269.538423:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984852352:12345-0@lo:400:kworker.0 Request processed in 33us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383269.538429:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787383269.539572:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787383269.539591:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984852608:0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.539653:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383269.539676:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984853120:0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.539698:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383269.539738:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984852864 00000100:00100000:1.0:1787383269.539746:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984852864 00000100:00100000:3.0:1787383269.540507:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984852096:0@lo:400:kworker.0 00000100:00100000:3.0:1787383269.540560:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984852608 00000100:00100000:3.0:1787383269.540564:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984852608 00000100:00100000:3.0:1787383269.540600:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984853120 00000100:00100000:3.0:1787383269.540602:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984853120 00000100:00100000:3.0:1787383269.540620:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787383269.540630:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984852736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383269.541106:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984852736:12345-0@lo:400:kworker.0 Request processed in 473us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383269.541117:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787383269.541143:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787383269.541152:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984853248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383269.541191:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984853248:12345-0@lo:400:kworker.0 Request processed in 42us (3093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383269.541198:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787383269.541211:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787383269.541218:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984852608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383269.541264:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984852608:12345-0@lo:400:kworker.0 Request processed in 46us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383269.541271:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787383269.541285:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787383269.541292:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984853120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383269.541747:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984853120:12345-0@lo:400:kworker.0 Request processed in 453us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383269.541785:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787383269.541816:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984851968 00000100:00100000:3.0:1787383269.541823:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984851968 00000100:00100000:1.0:1787383269.545905:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984853376 00000100:00100000:1.0:1787383269.545925:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984853376 00000100:00100000:1.0:1787383269.545969:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984852992 00000100:00100000:1.0:1787383269.545973:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984852992 00000100:00100000:1.0:1787383269.546003:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984853504 00000100:00100000:1.0:1787383269.546006:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984853504 00000100:00100000:1.0:1787383269.546030:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787383269.546041:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984852864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.546160:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984852864:12345-0@lo:400:kworker.0 Request processed in 120us (8836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383269.546169:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787383269.546190:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787383269.546196:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984853376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.546247:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984853376:12345-0@lo:400:kworker.0 Request processed in 51us (8863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383269.546254:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787383269.546265:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787383269.546270:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984852992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.546300:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984852992:12345-0@lo:400:kworker.0 Request processed in 29us (8512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383269.546306:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787383269.546316:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787383269.546322:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984853504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.546367:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984853504:12345-0@lo:400:kworker.0 Request processed in 45us (8539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383269.546373:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787383269.546435:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984852480 00000100:00100000:1.0:1787383269.546450:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984852480 00000100:00100000:1.0:1787383269.546471:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984852224 00000100:00100000:1.0:1787383269.546474:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984852224 00000100:00100000:1.0:1787383269.546490:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787383269.546495:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984852480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.546530:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984852480:12345-0@lo:400:kworker.0 Request processed in 34us (8805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383269.546536:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787383269.546549:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787383269.546555:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984852224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.546582:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984852224:12345-0@lo:400:kworker.0 Request processed in 27us (8570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383269.546597:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787383269.546911:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984852608:0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.546927:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984853120:0@lo:400:kworker.0 00000100:00100000:1.0:1787383269.546941:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984852480:0@lo:400:kworker.0 00010000:00080000:1.0:1787383269.546959:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c63480 x1874206984852992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383269.546971:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984852992:0@lo:400:kworker.0 00010000:00080000:1.0:1787383269.546984:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c60e00 x1874206984853504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383269.546992:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984853504:0@lo:400:kworker.0 00000100:00080000:2.0:1787383269.551342:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383269.551406:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383269.551411:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383269.551414:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383269.551551:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984852224:0@lo:400:kworker.0 00010000:00080000:2.0:1787383269.551656:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c61c00 x1874206984852736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383269.551668:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984852736:0@lo:400:kworker.0 00010000:00080000:2.0:1787383269.551682:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c61500 x1874206984853248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383269.551691:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984853248:0@lo:400:kworker.0 00000100:00100000:2.0:1787383269.551726:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984852352:0@lo:400:kworker.0 00010000:00080000:2.0:1787383269.551739:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c61f80 x1874206984852864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383269.551747:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984852864:0@lo:400:kworker.0 00010000:00080000:2.0:1787383269.551760:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c60000 x1874206984853376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383269.551838:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984853376:0@lo:400:kworker.0 00000100:00100000:3.0:1787383269.553693:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787383269.553717:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984851968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383269.554286:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984851968:12345-0@lo:400:kworker.0 Request processed in 575us (16615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383269.554297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787383269.554521:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984851968:0@lo:400:kworker.0 00000100:00100000:3.0:1787383270.043694:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984853632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383270.043814:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383270.043968:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383270.044172:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984853632 00000100:00100000:0.0:1787383270.044183:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984853632 00000100:00100000:2.0:1787383270.044383:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383270.044398:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984853760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383270.044438:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383270.050390:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984853760 00000100:00100000:0.0:1787383270.050410:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984853760 00000100:00100000:0.0:1787383270.050491:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787383270.050503:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984853632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383270.050543:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383270.050697:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984853632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 196us (6883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383270.050722:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787383270.050741:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787383270.050746:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984853760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383270.050756:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383270.050807:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984853760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (6368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383270.050813:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787383270.050863:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c60000 x1874206984853760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383270.050889:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984853760:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787383270.053335:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503024e00 x1874206984853632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383270.053365:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984853632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383270.554868:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383270.554892:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984853888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383270.554968:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383270.555071:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984853888 00000100:00100000:1.0:1787383270.555079:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984853888 00000100:00100000:1.0:1787383270.555133:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787383270.555143:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346bb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984853888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383270.555186:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787383270.555235:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346bb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984853888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383270.555242:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787383270.555505:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984853888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383271.067201:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984854016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383271.067269:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383271.067452:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383271.067461:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984854144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383271.067487:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383271.067558:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984854016 00000100:00100000:1.0:1787383271.067580:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984854016 00000100:00100000:1.0:1787383271.067625:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984854144 00000100:00100000:1.0:1787383271.067628:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984854144 00000100:00100000:1.0:1787383271.067642:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787383271.067722:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383271.067753:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984854016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383271.067797:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383271.067842:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984854016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383271.067848:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787383271.067864:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787383271.067869:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984854144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383271.067877:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383271.067895:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984854144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 26us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383271.067900:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1787383271.068065:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c61500 x1874206984854144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383271.068083:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984854144:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787383271.068094:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3ca80 x1874206984854016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383271.068116:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984854016:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787383271.068351:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383272.091155:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383272.501921:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383272.501963:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383272.501985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383272.502013:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383272.502030:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383272.502050:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383272.502076:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383272.502099:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965905664 00000100:00100000:0.0:1787383272.502108:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965905664 00000100:00100000:0.0:1787383272.502159:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965905920 00000100:00100000:0.0:1787383272.502162:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965905920 00000100:00100000:0.0:1787383272.502176:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965905536 00000100:00100000:0.0:1787383272.502190:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965905536 00000100:00100000:0.0:1787383272.502205:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965905792 00000100:00100000:0.0:1787383272.502206:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965905792 00000100:00100000:0.0:1787383272.502221:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:0.0:1787383272.502231:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965905664:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383272.502303:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965905664:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 73us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383272.502429:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:0.0:1787383272.502446:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:0.0:1787383272.502454:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2401:x1874206965905920:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383272.502481:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2401:x1874206965905920:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383272.502487:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:0.0:1787383272.502498:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:0.0:1787383272.502505:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2401:x1874206965905536:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383272.502528:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2401:x1874206965905536:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 24us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383272.502534:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:0.0:1787383272.502544:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 136 00000100:00100000:0.0:1787383272.502549:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2401:x1874206965905792:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383272.502570:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2401:x1874206965905792:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 20us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383272.502575:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 136 00000100:00100000:3.0:1787383272.502749:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965905408 00000100:00100000:3.0:1787383272.502754:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965905408 00000100:00100000:3.0:1787383272.502812:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 302 00000100:00100000:3.0:1787383272.502819:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2401:x1874206965905408:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383272.502850:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2401:x1874206965905408:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 32us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383272.502856:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 302 00000100:00080000:3.0:1787383272.502941:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383272.502946:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383272.503197:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965906176 00000100:00100000:1.0:1787383272.503201:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965906176 00000100:00100000:1.0:1787383272.503241:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965906048 00000100:00100000:1.0:1787383272.503244:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965906048 00000100:00100000:1.0:1787383272.503267:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:1.0:1787383272.503274:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2401:x1874206965906176:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383272.503393:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:0.0:1787383272.503402:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2401:x1874206965906048:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383272.503434:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2401:x1874206965906048:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 35us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383272.503440:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:1.0:1787383272.503534:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2401:x1874206965906176:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 35us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383272.503541:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00080000:3.0:1787383272.503646:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383272.503649:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1787383272.816147:0:12188:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787383273.115259:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787383273.117634:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f43e303e-1cf9-4e4a-9e69-93ff23e31c78 00000001:00100000:0.0:1787383273.121591:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f43e303e-1cf9-4e4a-9e69-93ff23e31c78 00000001:00100000:1.0:1787383273.122015:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f43e303e-1cf9-4e4a-9e69-93ff23e31c78 00000001:00100000:1.0:1787383273.122602:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f43e303e-1cf9-4e4a-9e69-93ff23e31c78 00000100:00100000:2.0:1787383273.627592:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984854272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383273.627843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383273.627975:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984854272 00000100:00100000:0.0:1787383273.627982:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984854272 00000100:00100000:0.0:1787383273.628030:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787383273.628039:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984854272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383273.628071:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787383273.628114:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984854272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383273.628120:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787383273.628206:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984854272:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787383274.139020:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383274.651232:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984854400:0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.651312:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383274.651359:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984854912:0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.651387:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383274.651418:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984855424:0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.651446:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383274.651462:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984855936:0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.651480:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383274.651510:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787383274.651517:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984854784:0@lo:400:kworker.0 00000100:00100000:1.0:1787383274.651541:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984854912 00000100:00100000:2.0:1787383274.651542:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383274.651555:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984854912 00000100:00100000:2.0:1787383274.651561:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984855296:0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.651586:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383274.651608:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984855808:0@lo:400:kworker.0 00000100:00100000:1.0:1787383274.651628:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787383274.651629:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383274.651642:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984854912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.651662:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984854528:0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.651713:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383274.651714:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984854912:12345-0@lo:400:kworker.0 Request processed in 74us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383274.651723:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787383274.651740:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984855040:0@lo:400:kworker.0 00000100:00100000:1.0:1787383274.651795:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984854912:0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.652429:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383274.652461:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984855552:0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.652485:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383274.652504:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787383274.652510:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984854656:0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.652531:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383274.652550:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984855168:0@lo:400:kworker.0 00000100:00100000:3.0:1787383274.652563:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984854784 00000100:00100000:3.0:1787383274.652570:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984854784 00000100:00100000:2.0:1787383274.652574:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383274.652594:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984855680:0@lo:400:kworker.0 00000100:00100000:3.0:1787383274.652600:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984854528 00000100:00100000:3.0:1787383274.652604:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984854528 00000100:00100000:2.0:1787383274.652616:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383274.652636:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984855424 00000100:00100000:2.0:1787383274.652641:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984855424 00000100:00100000:2.0:1787383274.652673:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984855936 00000100:00100000:2.0:1787383274.652676:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984855936 00000100:00100000:2.0:1787383274.652750:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984855296 00000100:00100000:2.0:1787383274.652754:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984855296 00000100:00100000:2.0:1787383274.652805:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984855808 00000100:00100000:2.0:1787383274.652809:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984855808 00000100:00100000:3.0:1787383274.652855:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984855040 00000100:00100000:3.0:1787383274.652859:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984855040 00000100:00100000:3.0:1787383274.652873:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984855552 00000100:00100000:3.0:1787383274.652875:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984855552 00000100:00100000:3.0:1787383274.652886:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984855168 00000100:00100000:3.0:1787383274.652888:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984855168 00000100:00100000:3.0:1787383274.652898:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984855680 00000100:00100000:3.0:1787383274.652900:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984855680 00000100:00100000:3.0:1787383274.652915:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787383274.652923:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984854784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.652948:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787383274.652956:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984855424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383274.652979:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984854784:12345-0@lo:400:kworker.0 Request processed in 56us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383274.652987:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787383274.653003:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984855424:12345-0@lo:400:kworker.0 Request processed in 46us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383274.653007:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787383274.653016:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787383274.653020:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984854528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.653036:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787383274.653045:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984855936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383274.653062:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984854528:12345-0@lo:400:kworker.0 Request processed in 45us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383274.653069:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787383274.653085:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984855936:12345-0@lo:400:kworker.0 Request processed in 40us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383274.653088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787383274.653098:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787383274.653099:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984855040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.653116:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787383274.653125:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984855296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383274.653135:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984855040:12345-0@lo:400:kworker.0 Request processed in 38us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383274.653141:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787383274.653152:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787383274.653157:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984855552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383274.653222:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787383274.653230:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984855168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383274.653282:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984855552:12345-0@lo:400:kworker.0 Request processed in 124us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383274.653288:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787383274.653311:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787383274.653317:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984855680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383274.653344:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984855680:12345-0@lo:400:kworker.0 Request processed in 27us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383274.653350:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787383274.653369:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787383274.653376:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984855808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383274.653413:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984855808:12345-0@lo:400:kworker.0 Request processed in 38us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383274.653420:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787383274.653442:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984854400 00000100:00100000:3.0:1787383274.653445:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984854400 00000100:00100000:3.0:1787383274.653482:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787383274.653488:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984854400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383274.653519:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984854400:12345-0@lo:400:kworker.0 Request processed in 31us (2208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383274.653524:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787383274.653583:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984854656 00000100:00100000:3.0:1787383274.653588:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984854656 00000100:00100000:3.0:1787383274.653812:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787383274.653820:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984854656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383274.653856:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984854656:12345-0@lo:400:kworker.0 Request processed in 38us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383274.653862:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1787383274.653888:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787383274.653892:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383274.653895:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383274.653897:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383274.653931:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984854656:0@lo:400:kworker.0 00010000:00080000:3.0:1787383274.653945:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c60380 x1874206984855680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383274.653956:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984855680:0@lo:400:kworker.0 00000100:00100000:3.0:1787383274.653967:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984854528:0@lo:400:kworker.0 00000100:00100000:3.0:1787383274.653987:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984855040:0@lo:400:kworker.0 00000100:00100000:3.0:1787383274.653996:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984855552:0@lo:400:kworker.0 00000100:00100000:0.0:1787383274.657966:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984854784:0@lo:400:kworker.0 00010000:00080000:0.0:1787383274.657984:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c63480 x1874206984855296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383274.657994:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984855296:0@lo:400:kworker.0 00010000:00080000:0.0:1787383274.658005:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f996a00 x1874206984855808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383274.658014:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984855808:0@lo:400:kworker.0 00000100:00100000:0.0:1787383274.658023:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984854400:0@lo:400:kworker.0 00010000:00080000:0.0:1787383274.658033:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c60a80 x1874206984855424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383274.658061:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984855424:0@lo:400:kworker.0 00010000:00080000:0.0:1787383274.658072:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f997480 x1874206984855936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383274.658079:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984855936:0@lo:400:kworker.0 00000100:00100000:2.0:1787383274.661788:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984855296:12345-0@lo:400:kworker.0 Request processed in 8643us (10179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383274.661803:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787383274.663074:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984855168:12345-0@lo:400:kworker.0 Request processed in 9838us (10494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383274.663087:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00010000:00080000:3.0:1787383274.665692:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c60e00 x1874206984855168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383274.665711:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984855168:0@lo:400:kworker.0 00000100:00100000:1.0:1787383275.163428:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984856064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383275.163571:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383275.163592:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383275.163624:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383275.163632:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984856192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383275.163656:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383275.163704:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984856064 00000100:00100000:1.0:1787383275.163712:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984856064 00000100:00100000:1.0:1787383275.163746:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984856192 00000100:00100000:1.0:1787383275.163749:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984856192 00000100:00100000:2.0:1787383275.163759:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787383275.163793:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984856064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383275.163823:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383275.163874:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984856064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (303us total) trans 0 rc 0/0 00010000:00080000:1.0:1787383275.163941:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3c700 x1874206984856064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383275.163960:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984856064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383275.164021:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787383275.164042:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787383275.164049:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984856192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787383275.164067:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383275.164109:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984856192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383275.164115:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1787383275.164139:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cd1f80 x1874206984856192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383275.164165:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984856192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383275.676095:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383275.676116:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984856320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383275.676180:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383275.676365:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984856320 00000100:00100000:2.0:1787383275.676372:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984856320 00000100:00100000:2.0:1787383275.676427:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787383275.676436:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984856320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383275.676469:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787383275.676519:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984856320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383275.676527:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787383275.676571:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984856320:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787383276.188157:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383276.189479:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350275e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984856448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383276.189547:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383276.189570:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984856448 00000100:00100000:1.0:1787383276.189578:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984856448 00000100:00100000:3.0:1787383276.189618:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350275ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984856576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383276.189636:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787383276.189646:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984856448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383276.189673:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383276.190083:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383276.190095:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984856448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 448us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383276.190105:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787383276.190114:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383276.190125:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984856576 00000100:00100000:1.0:1787383276.190245:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984856576 00000100:00100000:1.0:1787383276.190292:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787383276.190299:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984856576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383276.190311:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787383276.190320:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787383276.190325:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350275e680 x1874206984856448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383276.190345:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350275e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984856448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383276.190347:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984856576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383276.190354:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1787383276.190363:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350275ca80 x1874206984856576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383276.190379:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350275ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984856576:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787383277.211246:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383277.626451:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383277.626502:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383277.626537:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383277.626565:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383277.626584:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383277.626600:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383277.626624:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383277.626656:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965906560 00000100:00100000:3.0:1787383277.626668:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965906560 00000100:00100000:3.0:1787383277.626734:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965906816 00000100:00100000:3.0:1787383277.626747:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965906816 00000100:00100000:3.0:1787383277.626793:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965906432 00000100:00100000:3.0:1787383277.626796:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965906432 00000100:00100000:3.0:1787383277.626811:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965906688 00000100:00100000:3.0:1787383277.626813:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965906688 00000100:00100000:3.0:1787383277.626829:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 143 00000100:00100000:3.0:1787383277.626840:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965906560:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383277.626937:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965906560:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 98us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383277.626946:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 143 00000100:00100000:3.0:1787383277.626976:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:3.0:1787383277.626983:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965906816:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383277.627008:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965906816:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383277.627015:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:3.0:1787383277.627026:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 145 00000100:00100000:3.0:1787383277.627031:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965906432:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383277.627053:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965906432:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 22us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383277.627059:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 145 00000100:00100000:3.0:1787383277.627071:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 146 00000100:00100000:3.0:1787383277.627077:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965906688:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383277.627099:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965906688:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 22us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383277.627104:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 146 00000100:00100000:3.0:1787383277.627131:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965907072 00000100:00100000:3.0:1787383277.627134:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965907072 00000100:00100000:3.0:1787383277.627163:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965906944 00000100:00100000:3.0:1787383277.627166:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965906944 00000100:00100000:3.0:1787383277.627186:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:3.0:1787383277.627192:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965907072:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383277.627221:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965907072:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 30us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383277.627227:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:3.0:1787383277.627237:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:3.0:1787383277.627243:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965906944:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383277.627263:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965906944:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 21us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383277.627269:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00080000:3.0:1787383277.627306:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383277.627311:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383277.627313:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383277.627315:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383277.627665:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965906304 00000100:00100000:2.0:1787383277.627670:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965906304 00000100:00100000:2.0:1787383277.627710:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 304 00000100:00100000:2.0:1787383277.627717:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2403:x1874206965906304:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383277.627758:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2403:x1874206965906304:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 42us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383277.627783:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 304 00010000:00010000:2.0:1787383278.235755:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383278.747935:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383278.747967:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984856704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383278.748056:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383278.748163:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984856704 00000100:00100000:2.0:1787383278.748173:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984856704 00000100:00100000:2.0:1787383278.748233:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787383278.748252:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984856704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787383278.748308:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787383278.748374:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984856704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383278.748382:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787383278.748442:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984856704:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787383279.260217:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383279.772938:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383279.772996:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383279.773017:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984856960:0@lo:400:kworker.0 00000100:00100000:2.0:1787383279.773082:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383279.773150:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984856960 00000100:00100000:2.0:1787383279.773157:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984856960 00000100:00100000:2.0:1787383279.773202:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787383279.773211:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984856960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383279.773275:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984856960:12345-0@lo:400:kworker.0 Request processed in 64us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383279.773283:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787383279.773322:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984856960:0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.777620:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350275e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984856832:0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.778092:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383279.778182:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984856832 00000100:00100000:2.0:1787383279.778190:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984856832 00000100:00100000:2.0:1787383279.778243:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787383279.778253:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984856832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383279.778316:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984856832:12345-0@lo:400:kworker.0 Request processed in 64us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383279.778331:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787383279.778565:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984857088:0@lo:400:kworker.0 00000100:00100000:3.0:1787383279.778597:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383279.778618:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984857600:0@lo:400:kworker.0 00000100:00100000:3.0:1787383279.778640:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383279.778655:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984858112:0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.779355:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984857472:0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.779403:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383279.779428:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984857984:0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.779449:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383279.779480:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350275e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984856832:0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.779501:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787383279.779507:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984857344:0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.779530:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383279.779560:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984857856:0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.779582:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383279.779601:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984858368:0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.779621:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383279.779672:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984857600 00000100:00100000:0.0:1787383279.779678:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984857600 00000100:00100000:0.0:1787383279.779717:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984857472 00000100:00100000:0.0:1787383279.779720:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984857472 00000100:00100000:0.0:1787383279.779736:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984857984 00000100:00100000:0.0:1787383279.779738:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984857984 00000100:00100000:0.0:1787383279.779753:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787383279.779760:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984857600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.779815:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984857600:12345-0@lo:400:kworker.0 Request processed in 56us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383279.779822:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787383279.779834:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787383279.779840:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984857472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.779870:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984857472:12345-0@lo:400:kworker.0 Request processed in 31us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383279.779877:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787383279.779887:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787383279.779892:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984857984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.779917:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984857984:12345-0@lo:400:kworker.0 Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383279.779922:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787383279.780117:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984857088 00000100:00100000:0.0:1787383279.780122:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984857088 00000100:00100000:0.0:1787383279.780142:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984857344 00000100:00100000:0.0:1787383279.780145:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984857344 00000100:00100000:0.0:1787383279.780160:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787383279.780166:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984857088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.780199:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984857088:12345-0@lo:400:kworker.0 Request processed in 34us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383279.780211:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787383279.780226:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787383279.780231:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984857344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.780271:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984857344:12345-0@lo:400:kworker.0 Request processed in 39us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383279.780277:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787383279.780297:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984857856 00000100:00100000:0.0:1787383279.780301:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984857856 00000100:00100000:0.0:1787383279.780327:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984858368 00000100:00100000:0.0:1787383279.780329:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984858368 00000100:00100000:0.0:1787383279.780348:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787383279.780354:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984857856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.780383:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984857856:12345-0@lo:400:kworker.0 Request processed in 29us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383279.780389:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787383279.780400:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787383279.780406:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984858368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.780432:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f997480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984858368:12345-0@lo:400:kworker.0 Request processed in 27us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383279.780438:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787383279.780455:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383279.780460:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383279.780462:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383279.780465:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383279.780494:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984857344:0@lo:400:kworker.0 00010000:00080000:0.0:1787383279.780505:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d42a00 x1874206984857856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383279.780523:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984857856:0@lo:400:kworker.0 00010000:00080000:0.0:1787383279.780537:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503388000 x1874206984858368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383279.780744:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984858368:0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.780787:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984857472:0@lo:400:kworker.0 00000100:00100000:0.0:1787383279.780800:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984857984:0@lo:400:kworker.0 00000100:00100000:3.0:1787383279.781145:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383279.781189:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503777b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984857088:0@lo:400:kworker.0 00010000:00080000:3.0:1787383279.781217:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d42d80 x1874206984857600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383279.781235:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984857600:0@lo:400:kworker.0 00000100:00100000:3.0:1787383279.781248:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787383279.781267:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984857216:0@lo:400:kworker.0 00000100:00100000:3.0:1787383279.781292:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383279.781308:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984857728:0@lo:400:kworker.0 00000100:00100000:3.0:1787383279.781328:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383279.781343:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984858240:0@lo:400:kworker.0 00000100:00100000:3.0:1787383279.781363:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383279.781411:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984858112 00000100:00100000:3.0:1787383279.781416:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984858112 00000100:00100000:3.0:1787383279.781446:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984857216 00000100:00100000:3.0:1787383279.781448:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984857216 00000100:00100000:3.0:1787383279.781463:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787383279.781469:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984858112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383279.781507:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984858112:12345-0@lo:400:kworker.0 Request processed in 37us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383279.781513:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787383279.781526:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787383279.781531:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984857216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383279.781571:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984857216:12345-0@lo:400:kworker.0 Request processed in 39us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383279.781577:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787383279.781594:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984857728 00000100:00100000:3.0:1787383279.781597:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984857728 00000100:00100000:3.0:1787383279.781617:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984858240 00000100:00100000:3.0:1787383279.781625:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984858240 00000100:00100000:3.0:1787383279.781642:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787383279.781648:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984857728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383279.781824:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984857728:12345-0@lo:400:kworker.0 Request processed in 175us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383279.781831:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787383279.781842:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787383279.781847:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984858240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383279.781873:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984858240:12345-0@lo:400:kworker.0 Request processed in 26us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383279.781878:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787383279.781908:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503775180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984857216:0@lo:400:kworker.0 00010000:00080000:3.0:1787383279.781918:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d43480 x1874206984857728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383279.781928:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984857728:0@lo:400:kworker.0 00010000:00080000:3.0:1787383279.781937:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d41180 x1874206984858240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383279.783778:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984858240:0@lo:400:kworker.0 00010000:00080000:3.0:1787383279.783820:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d41c00 x1874206984858112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383279.783833:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984858112:0@lo:400:kworker.0 00000100:00080000:0.0:1787383279.784309:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383279.784316:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383279.784319:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383280.283113:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383280.283136:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984858496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383280.283200:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383280.283266:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984858496 00000100:00100000:1.0:1787383280.283273:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984858496 00000100:00100000:1.0:1787383280.283340:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787383280.283348:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984858496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383280.283375:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383280.283557:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984858496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 209us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383280.283565:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1787383280.283694:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3c000 x1874206984858496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383280.283710:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984858496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383280.283965:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383280.283976:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984858624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383280.284008:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383280.284038:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383280.284045:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984858624 00000100:00100000:0.0:1787383280.284048:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984858624 00000100:00100000:0.0:1787383280.284070:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787383280.284075:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984858624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383280.284086:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383280.284111:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984858624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383280.284117:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1787383280.284140:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f996a00 x1874206984858624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383280.284152:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f996a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984858624:0@lo:13:osp-pre-1-1.0 00000020:00000004:1.0:1787383280.390617:0:12504:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787383280.391299:0:12504:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787383280.797315:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383280.797338:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984858752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383280.797398:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383280.798543:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984858752 00000100:00100000:1.0:1787383280.798553:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984858752 00000100:00100000:1.0:1787383280.798609:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787383280.798617:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984858752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383280.798646:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787383280.798705:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984858752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383280.798712:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787383280.798831:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984858752:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787383281.307823:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383281.310396:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984858880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383281.310466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383281.311322:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984858880 00000100:00100000:3.0:1787383281.311329:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984858880 00000100:00100000:3.0:1787383281.311375:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787383281.311384:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363dd51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984858880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787383281.311409:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383281.311455:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363dd51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984858880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383281.311462:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787383281.311942:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787383281.311975:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d3b80 x1874206984858880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383281.311994:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984858880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383281.312011:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383281.312029:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984859008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383281.312063:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383281.312097:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984859008 00000100:00100000:2.0:1787383281.312102:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984859008 00000100:00100000:2.0:1787383281.312137:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787383281.312144:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984859008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383281.312155:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383281.312185:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984859008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383281.312191:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1787383281.312218:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d1f80 x1874206984859008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383281.312242:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984859008:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787383281.312664:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787383282.337420:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787383282.353996:0:12601:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787383282.354234:0:12601:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787383282.740283:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383282.740330:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383282.740356:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383282.740380:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383282.740403:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383282.740432:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965907456 00000100:00100000:3.0:1787383282.740442:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965907456 00000100:00100000:3.0:1787383282.740498:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965907712 00000100:00100000:3.0:1787383282.740502:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965907712 00000100:00100000:3.0:1787383282.740522:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965907328 00000100:00100000:3.0:1787383282.740525:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965907328 00000100:00100000:3.0:1787383282.740542:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 153 00000100:00100000:3.0:1787383282.740550:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965907456:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383282.740572:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 154 00000100:00100000:2.0:1787383282.740585:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965907712:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383282.740630:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965907456:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 78us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383282.740631:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965907712:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 47us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383282.740647:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 153 00000100:00100000:1.0:1787383282.740688:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965907200 00000100:00100000:1.0:1787383282.740704:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965907200 00000100:00100000:1.0:1787383282.740734:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 306 00000100:00100000:1.0:1787383282.740740:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965907200:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383282.740788:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965907200:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 27us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383282.740795:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 306 00000100:00100000:2.0:1787383282.740897:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 154 00000100:00100000:2.0:1787383282.740925:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 155 00000100:00100000:2.0:1787383282.740933:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965907328:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383282.740964:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965907328:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 33us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383282.740971:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 155 00000100:00080000:2.0:1787383282.745868:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383282.745881:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383282.746551:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965907968 00000100:00100000:1.0:1787383282.746563:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965907968 00000100:00100000:1.0:1787383282.746646:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 75 00000100:00100000:1.0:1787383282.746657:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965907968:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383282.746735:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965907968:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 80us (6352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383282.746744:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 75 00000100:00080000:2.0:1787383282.747270:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787383282.748737:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383282.748785:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383282.748812:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965907840 00000100:00100000:1.0:1787383282.748820:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965907840 00000100:00100000:1.0:1787383282.748866:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 76 00000100:00100000:1.0:1787383282.748874:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965907840:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383282.749047:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965907584 00000100:00100000:3.0:1787383282.749051:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965907584 00000100:00100000:3.0:1787383282.749082:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 156 00000100:00100000:3.0:1787383282.749089:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965907584:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383282.749143:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965907584:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 54us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383282.749150:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 156 00000100:00100000:1.0:1787383282.750426:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965907840:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 1544us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383282.750437:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 76 00000100:00080000:2.0:1787383282.751961:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383282.751970:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787383283.358965:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383283.868040:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383283.868098:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984859136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383283.868163:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383283.868355:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984859136 00000100:00100000:0.0:1787383283.868364:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984859136 00000100:00100000:0.0:1787383283.868414:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787383283.868423:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984859136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383283.868454:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787383283.868547:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984859136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383283.868555:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787383283.868923:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984859136:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1787383284.233282:0:12698:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787383284.234224:0:12698:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787383284.381526:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383284.893715:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984859264:0@lo:400:kworker.0 00000100:00100000:0.0:1787383284.893808:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383284.893928:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984859264 00000100:00100000:1.0:1787383284.893936:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984859264 00000100:00100000:1.0:1787383284.893988:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787383284.893998:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984859264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383284.894899:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984859392:0@lo:400:kworker.0 00000100:00100000:3.0:1787383284.894943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383284.894979:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383284.894986:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984859520:0@lo:400:kworker.0 00000100:00100000:3.0:1787383284.895012:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383284.895039:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984859648:0@lo:400:kworker.0 00000100:00100000:3.0:1787383284.895061:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383284.895106:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984859520 00000100:00100000:3.0:1787383284.895111:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984859520 00000100:00100000:3.0:1787383284.895146:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787383284.895155:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984859520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383284.895196:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984859520:12345-0@lo:400:kworker.0 Request processed in 43us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383284.895203:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787383284.895257:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984859520:0@lo:400:kworker.0 00000100:00100000:3.0:1787383284.895738:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984859392 00000100:00100000:3.0:1787383284.895744:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984859392 00000100:00100000:3.0:1787383284.895798:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984859648 00000100:00100000:3.0:1787383284.895801:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984859648 00000100:00100000:3.0:1787383284.895823:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787383284.895831:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984859392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383284.896006:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984859392:12345-0@lo:400:kworker.0 Request processed in 175us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383284.896013:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787383284.896027:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787383284.896034:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984859648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383284.896068:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984859648:12345-0@lo:400:kworker.0 Request processed in 35us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383284.896074:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787383284.896109:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984859648:0@lo:400:kworker.0 00000100:00100000:3.0:1787383284.896135:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984859392:0@lo:400:kworker.0 00000100:00100000:1.0:1787383284.898039:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984859264:12345-0@lo:400:kworker.0 Request processed in 4036us (4223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383284.898054:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787383284.901415:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984859264:0@lo:400:kworker.0 00000100:00100000:2.0:1787383284.902126:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383284.903013:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984859776:0@lo:400:kworker.0 00000100:00100000:2.0:1787383284.903072:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383284.903295:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984859776 00000100:00100000:1.0:1787383284.903302:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984859776 00000100:00100000:1.0:1787383284.903345:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787383284.903353:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984859776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383284.903407:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984859776:12345-0@lo:400:kworker.0 Request processed in 55us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383284.903414:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787383284.903605:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984859776:0@lo:400:kworker.0 00000100:00100000:2.0:1787383284.903652:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984860160:0@lo:400:kworker.0 00000100:00100000:2.0:1787383284.903681:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383284.903710:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984860160 00000100:00100000:2.0:1787383284.903713:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984860160 00000100:00100000:2.0:1787383284.903749:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787383284.903756:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984860160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383284.903814:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984860160:12345-0@lo:400:kworker.0 Request processed in 59us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383284.903833:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787383284.903850:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787383284.903872:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640950a80 x1874206984860160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383284.903882:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984860160:0@lo:400:kworker.0 00000100:00100000:2.0:1787383284.903908:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383284.903913:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984860288:0@lo:400:kworker.0 00000100:00100000:0.0:1787383284.903968:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984859904:0@lo:400:kworker.0 00000100:00100000:0.0:1787383284.904003:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383284.904028:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383284.904034:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984860032:0@lo:400:kworker.0 00000100:00100000:0.0:1787383284.904055:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383284.904088:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984859904 00000100:00100000:0.0:1787383284.904093:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984859904 00000100:00100000:0.0:1787383284.904122:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984860032 00000100:00100000:0.0:1787383284.904125:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984860032 00000100:00100000:0.0:1787383284.904145:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787383284.904151:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984859904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383284.904200:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984859904:12345-0@lo:400:kworker.0 Request processed in 49us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383284.904214:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787383284.904238:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787383284.904245:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984860032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383284.904286:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984860032:12345-0@lo:400:kworker.0 Request processed in 30us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383284.904293:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1787383284.904310:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383284.904313:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787383284.904826:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640953b80 x1874206984860032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383284.904837:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984860032:0@lo:400:kworker.0 00000100:00100000:0.0:1787383284.904847:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984859904:0@lo:400:kworker.0 00000100:00100000:2.0:1787383284.905095:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383284.905206:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383284.905216:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984860416:0@lo:400:kworker.0 00000100:00100000:2.0:1787383284.905262:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383284.905290:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984860416 00000100:00100000:2.0:1787383284.905294:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984860416 00000100:00100000:2.0:1787383284.905330:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787383284.905338:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984860416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383284.905375:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984860416:12345-0@lo:400:kworker.0 Request processed in 39us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383284.905382:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1787383284.905406:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383284.905416:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984860416:0@lo:400:kworker.0 00000100:00100000:2.0:1787383284.905490:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984860672:0@lo:400:kworker.0 00000100:00100000:2.0:1787383284.905527:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383284.905527:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984860544:0@lo:400:kworker.0 00000100:00100000:0.0:1787383284.905562:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383284.905591:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984860544 00000100:00100000:0.0:1787383284.905595:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984860544 00000100:00100000:0.0:1787383284.905623:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787383284.905629:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984860544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383284.905661:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984860544:12345-0@lo:400:kworker.0 Request processed in 32us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383284.905666:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1787383284.906471:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787383284.906501:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640953100 x1874206984860544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383284.906528:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984860544:0@lo:400:kworker.0 00000100:00100000:1.0:1787383284.907352:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984860288 00000100:00100000:1.0:1787383284.907360:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984860288 00000100:00100000:1.0:1787383284.907411:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984860672 00000100:00100000:1.0:1787383284.907415:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984860672 00000100:00100000:1.0:1787383284.907437:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787383284.907447:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984860288:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787383284.907462:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383284.907467:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383284.907524:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984860288:12345-0@lo:400:kworker.0 Request processed in 78us (2428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383284.907531:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787383284.907546:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787383284.907552:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984860672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383284.907581:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984860672:12345-0@lo:400:kworker.0 Request processed in 29us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383284.907586:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1787383284.907664:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640952300 x1874206984860672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383284.907785:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984860672:0@lo:400:kworker.0 00010000:00080000:0.0:1787383284.907802:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640950a80 x1874206984860288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383284.907810:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640950a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984860288:0@lo:400:kworker.0 00000100:00100000:1.0:1787383284.908111:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383284.908184:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984860800:0@lo:400:kworker.0 00000100:00100000:1.0:1787383284.908242:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383284.908387:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984860800 00000100:00100000:2.0:1787383284.908392:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984860800 00000100:00100000:2.0:1787383284.908479:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787383284.908489:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984860800:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787383284.908502:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383284.908553:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984860800:12345-0@lo:400:kworker.0 Request processed in 66us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383284.908562:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1787383284.908623:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640952a00 x1874206984860800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383284.908953:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984860800:0@lo:400:kworker.0 00010000:00010000:0.0:1787383285.402980:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383285.403072:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984860928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383285.403141:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383285.403230:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383285.403237:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984861056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383285.403264:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383285.403399:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984860928 00000100:00100000:0.0:1787383285.403407:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984860928 00000100:00100000:1.0:1787383285.403450:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984861056 00000100:00100000:0.0:1787383285.403456:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787383285.403458:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984861056 00000100:00100000:0.0:1787383285.403468:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984860928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383285.403499:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383285.403564:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984860928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383285.403572:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787383285.403589:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787383285.403595:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984861056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383285.403621:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383285.403648:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984861056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383285.403655:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1787383285.403746:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3df80 x1874206984861056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383285.403798:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984861056:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787383285.403812:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d42a00 x1874206984860928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383285.403822:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984860928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383285.915481:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383285.915502:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984861184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383285.915560:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383285.915638:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984861184 00000100:00100000:0.0:1787383285.915645:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984861184 00000100:00100000:0.0:1787383285.915691:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787383285.915700:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984861184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383285.915733:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787383285.915793:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984861184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383285.915801:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787383285.915849:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984861184:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1787383286.066301:0:12795:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383286.066535:0:12795:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787383286.426878:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383286.432058:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984861312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383286.432117:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383286.432177:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984861312 00000100:00100000:1.0:1787383286.432183:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984861312 00000100:00100000:1.0:1787383286.432238:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787383286.432247:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984861312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383286.432273:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383286.432307:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984861312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383286.432313:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1787383286.432346:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3d880 x1874206984861312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383286.432362:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984861312:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787383286.432386:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383286.433142:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383286.433162:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984861440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383286.433194:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383286.433348:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984861440 00000100:00100000:0.0:1787383286.433353:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984861440 00000100:00100000:0.0:1787383286.433404:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787383286.433412:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984861440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383286.433430:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383286.433467:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984861440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383286.433473:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1787383286.433504:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d42a00 x1874206984861440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383286.433533:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984861440:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787383286.433633:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787383287.451018:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383287.860259:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383287.860389:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383287.865508:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383287.865541:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965908096 00000100:00100000:2.0:1787383287.865550:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965908096 00000100:00100000:2.0:1787383287.865597:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 308 00000100:00100000:2.0:1787383287.865606:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965908096:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383287.865886:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965908096:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 280us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383287.865895:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 308 00000100:00100000:2.0:1787383287.865944:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383287.866173:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965908224 00000100:00100000:0.0:1787383287.866179:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965908224 00000100:00100000:0.0:1787383287.867393:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965908480 00000100:00100000:0.0:1787383287.867402:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965908480 00000100:00100000:0.0:1787383287.867436:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 163 00000100:00100000:0.0:1787383287.867443:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965908224:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383287.867500:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965908224:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 57us (7324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383287.867507:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 163 00000100:00100000:0.0:1787383287.867533:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 164 00000100:00100000:0.0:1787383287.867540:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965908480:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383287.867567:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965908480:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 27us (7179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383287.867573:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 164 00000100:00080000:1.0:1787383287.872891:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383287.875848:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965908352 00000100:00100000:2.0:1787383287.875859:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383287.875859:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965908352 00000100:00100000:0.0:1787383287.875917:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965908608 00000100:00100000:0.0:1787383287.875921:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965908608 00000100:00100000:0.0:1787383287.875945:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 165 00000100:00100000:0.0:1787383287.875953:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965908352:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383287.876030:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965908352:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 76us (10084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383287.876043:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 165 00000100:00100000:2.0:1787383287.876044:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383287.876070:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965908736 00000100:00100000:2.0:1787383287.876075:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965908736 00000100:00100000:0.0:1787383287.876081:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 166 00000100:00100000:0.0:1787383287.876089:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965908608:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383287.876114:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:0.0:1787383287.876126:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965908608:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 35us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383287.876127:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2400:x1874206965908736:12345-192.168.203.2@tcp:9:kworker.0 00000100:00100000:0.0:1787383287.876142:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 166 00000020:00000080:2.0:1787383287.876250:0:8914:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e5b3 00000100:00080000:2.0:1787383287.876260:0:8914:0:(import.c:65:import_set_state_nolock()) ffff96363f98c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787383287.876302:0:8914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787383287.876422:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+2:2400:x1874206965908736:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 298us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383287.876429:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00080000:1.0:1787383287.877073:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383287.877080:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787383287.877147:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383287.877545:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383287.877953:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965908864 00000100:00100000:0.0:1787383287.877961:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965908864 00000100:00100000:0.0:1787383287.878012:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:0.0:1787383287.878021:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2400:x1874206965908864:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:0.0:1787383287.878046:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e5ba 00000100:00080000:0.0:1787383287.878053:0:8436:0:(import.c:65:import_set_state_nolock()) ffff96363f930000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787383287.878089:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787383287.878243:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+2:2400:x1874206965908864:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 222us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383287.878251:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00010000:00010000:0.0:1787383287.878272:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787383287.881873:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000004:2.0:1787383288.140438:0:12893:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383288.141264:0:12893:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787383288.479479:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383288.994509:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984861568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383288.994577:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383288.994661:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984861568 00000100:00100000:0.0:1787383288.994668:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984861568 00000100:00100000:0.0:1787383288.994710:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787383288.994716:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984861568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383288.994745:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787383288.994808:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984861568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383288.994830:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787383288.994875:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984861568:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787383289.499832:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383290.019251:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984861824:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.019319:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383290.019364:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984862336:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.019387:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383290.019410:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350338b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984862848:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.019430:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383290.019456:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787383290.019462:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984861696:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.019489:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383290.019509:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984862208:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.019533:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383290.019562:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984862720:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.019587:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383290.019605:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984863232:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.019624:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383290.019651:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984861952:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.019672:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383290.019688:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984862464:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.019707:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383290.019722:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350338aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984862976:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.019741:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383290.019758:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787383290.019790:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984862080:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.019812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383290.019823:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984862592:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.019840:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383290.019856:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350338a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984863104:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.019874:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383290.019905:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984861824 00000100:00100000:3.0:1787383290.019913:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984861824 00000100:00100000:3.0:1787383290.019948:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984862336 00000100:00100000:3.0:1787383290.019951:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984862336 00000100:00100000:3.0:1787383290.019971:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984862848 00000100:00100000:3.0:1787383290.019974:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984862848 00000100:00100000:3.0:1787383290.019986:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984862464 00000100:00100000:3.0:1787383290.019988:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984862464 00000100:00100000:3.0:1787383290.020000:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984862976 00000100:00100000:3.0:1787383290.020003:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984862976 00000100:00100000:3.0:1787383290.020025:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984862080 00000100:00100000:3.0:1787383290.020028:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984862080 00000100:00100000:3.0:1787383290.020042:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787383290.020050:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984861824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.020101:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984861824:12345-0@lo:400:kworker.0 Request processed in 51us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383290.020108:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787383290.020125:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787383290.020408:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984862208 00000100:00100000:2.0:1787383290.020413:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984862208 00000100:00100000:2.0:1787383290.020438:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984861952 00000100:00100000:2.0:1787383290.020440:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984861952 00000100:00100000:2.0:1787383290.020456:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787383290.020462:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984862208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383290.020503:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984862208:12345-0@lo:400:kworker.0 Request processed in 40us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.020509:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787383290.020526:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787383290.020533:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984861952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383290.020568:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984861952:12345-0@lo:400:kworker.0 Request processed in 36us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.020581:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787383290.020602:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984862720 00000100:00100000:2.0:1787383290.020606:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984862720 00000100:00100000:2.0:1787383290.020623:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984863232 00000100:00100000:2.0:1787383290.020626:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984863232 00000100:00100000:2.0:1787383290.020637:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984862592 00000100:00100000:2.0:1787383290.020639:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984862592 00000100:00100000:2.0:1787383290.020652:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984863104 00000100:00100000:2.0:1787383290.020655:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984863104 00000100:00100000:2.0:1787383290.020669:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787383290.020676:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984862720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383290.020708:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984862720:12345-0@lo:400:kworker.0 Request processed in 33us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.020715:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787383290.020725:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787383290.020731:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984863232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383290.020759:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984863232:12345-0@lo:400:kworker.0 Request processed in 28us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.020784:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787383290.020796:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787383290.020802:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984862592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383290.020830:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984862592:12345-0@lo:400:kworker.0 Request processed in 28us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.020836:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787383290.020846:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787383290.020852:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984863104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383290.020891:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984863104:12345-0@lo:400:kworker.0 Request processed in 38us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.020897:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1787383290.020975:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383290.020981:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383290.020983:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383290.020985:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383290.021534:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984861696 00000100:00100000:1.0:1787383290.021540:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984861696 00000100:00100000:1.0:1787383290.021581:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787383290.021588:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984861696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383290.021635:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984861696:12345-0@lo:400:kworker.0 Request processed in 48us (2145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383290.021641:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787383290.021847:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984861696:0@lo:400:kworker.0 00000100:00100000:0.0:1787383290.021862:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984862208:0@lo:400:kworker.0 00010000:00080000:0.0:1787383290.021875:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635033b8000 x1874206984862720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383290.021885:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984862720:0@lo:400:kworker.0 00010000:00080000:0.0:1787383290.021896:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503024a80 x1874206984863232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383290.021903:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984863232:0@lo:400:kworker.0 00000100:00100000:0.0:1787383290.021915:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984861824:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.021994:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984862336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.022038:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984862336:12345-0@lo:400:kworker.0 Request processed in 48us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383290.022101:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984862336:0@lo:400:kworker.0 00000100:00100000:2.0:1787383290.022205:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787383290.022215:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984862848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383290.022252:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984862848:12345-0@lo:400:kworker.0 Request processed in 39us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.022259:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787383290.022273:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787383290.022280:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984862464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383290.022308:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984862464:12345-0@lo:400:kworker.0 Request processed in 29us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.022314:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787383290.022326:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787383290.022332:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984862976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383290.022360:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984862976:12345-0@lo:400:kworker.0 Request processed in 28us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.022365:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787383290.022376:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787383290.022383:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984862080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383290.022409:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984862080:12345-0@lo:400:kworker.0 Request processed in 26us (2597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.022414:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787383290.022446:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984862080:0@lo:400:kworker.0 00010000:00080000:2.0:1787383290.022470:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cd3800 x1874206984862592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383290.022480:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984862592:0@lo:400:kworker.0 00010000:00080000:2.0:1787383290.022491:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350338a680 x1874206984863104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383290.022499:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350338a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984863104:0@lo:400:kworker.0 00000100:00100000:2.0:1787383290.022510:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984861952:0@lo:400:kworker.0 00010000:00080000:2.0:1787383290.022520:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cd2d80 x1874206984862464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383290.022526:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984862464:0@lo:400:kworker.0 00010000:00080000:2.0:1787383290.022535:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350338aa00 x1874206984862976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383290.022542:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350338aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984862976:0@lo:400:kworker.0 00000100:00100000:1.0:1787383290.023244:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350338b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984862848:0@lo:400:kworker.0 00000100:00100000:3.0:1787383290.027858:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00010000:2.0:1787383290.525469:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383290.525539:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984863360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383290.525602:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383290.525670:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984863360 00000100:00100000:2.0:1787383290.525678:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984863360 00000100:00100000:2.0:1787383290.525722:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787383290.525730:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984863360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787383290.525755:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383290.525810:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984863360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.525827:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1787383290.525870:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640950380 x1874206984863360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383290.525900:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984863360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383290.527147:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383290.527363:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984863488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383290.527432:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383290.527670:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984863488 00000100:00100000:2.0:1787383290.527678:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984863488 00000100:00100000:2.0:1787383290.527729:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787383290.527740:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984863488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383290.527780:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383290.527829:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984863488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383290.527835:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1787383290.529385:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3c000 x1874206984863488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383290.529409:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984863488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383291.035095:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383291.035117:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984863616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383291.035213:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383291.035398:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984863616 00000100:00100000:0.0:1787383291.035406:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984863616 00000100:00100000:0.0:1787383291.035459:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787383291.035468:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984863616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383291.035499:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787383291.035548:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984863616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383291.035571:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787383291.035617:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984863616:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787383291.547048:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383291.547306:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984863744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383291.547377:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383291.547524:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984863744 00000100:00100000:0.0:1787383291.547602:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984863744 00000100:00100000:0.0:1787383291.547703:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787383291.547713:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984863744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383291.547743:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383291.547819:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984863744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383291.547828:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1787383291.547843:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d41500 x1874206984863744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383291.547865:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984863744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383291.547939:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984863872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383291.547970:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383291.554149:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984863872 00000100:00100000:2.0:1787383291.554163:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984863872 00000100:00100000:2.0:1787383291.554222:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787383291.554233:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984863872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787383291.554260:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383291.554371:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984863872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (6399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383291.554379:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1787383291.556865:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503687100 x1874206984863872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383291.557084:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984863872:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1787383291.866232:0:13037:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787383292.571278:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383292.981908:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383292.982003:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383292.982029:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383292.982053:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383292.982092:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383292.982146:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965909248 00000100:00100000:3.0:1787383292.982156:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965909248 00000100:00100000:3.0:1787383292.982219:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965909504 00000100:00100000:3.0:1787383292.982223:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965909504 00000100:00100000:3.0:1787383292.982238:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965909120 00000100:00100000:3.0:1787383292.982240:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965909120 00000100:00100000:3.0:1787383292.982252:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965909376 00000100:00100000:3.0:1787383292.982255:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965909376 00000100:00100000:3.0:1787383292.982270:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 173 00000100:00100000:3.0:1787383292.982279:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965909248:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383292.982347:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965909248:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 68us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383292.982354:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 173 00000100:00100000:3.0:1787383292.982370:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 174 00000100:00100000:3.0:1787383292.982377:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965909504:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383292.982399:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965909504:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 22us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383292.982405:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 174 00000100:00100000:3.0:1787383292.982415:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 175 00000100:00100000:3.0:1787383292.982420:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965909120:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383292.982481:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965909120:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 60us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383292.982488:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 175 00000100:00100000:3.0:1787383292.982500:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 176 00000100:00100000:3.0:1787383292.982506:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965909376:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383292.982529:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965909376:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383292.982544:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 176 00000100:00080000:3.0:1787383292.982566:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383292.982571:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383292.984731:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965908992 00000100:00100000:1.0:1787383292.984744:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965908992 00000100:00100000:1.0:1787383292.984896:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 310 00000100:00100000:1.0:1787383292.984906:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965908992:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383292.984979:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965908992:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 76us (3080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383292.984986:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 310 00010000:00010000:0.0:1787383293.594876:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383294.107146:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984864000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383294.107283:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1787383294.110963:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f43e303e-1cf9-4e4a-9e69-93ff23e31c78 00000020:00000080:1.0:1787383294.110973:0:9513:0:(genops.c:906:class_export_put()) final put ffff96363f937000/f43e303e-1cf9-4e4a-9e69-93ff23e31c78 00000001:00100000:1.0:1787383294.111027:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f43e303e-1cf9-4e4a-9e69-93ff23e31c78 00000020:00000080:1.0:1787383294.111030:0:8429:0:(genops.c:906:class_export_put()) final put ffff96363f98e000/f43e303e-1cf9-4e4a-9e69-93ff23e31c78 00000020:00000080:3.0:1787383294.111447:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96363f937000/f43e303e-1cf9-4e4a-9e69-93ff23e31c78 for lustre-OST0001 00000020:00000080:3.0:1787383294.111492:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96363f98e000/f43e303e-1cf9-4e4a-9e69-93ff23e31c78 for lustre-OST0000 00000020:00000080:3.0:1787383294.111511:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363f930000 for lustre-OST0001 00000020:00000080:3.0:1787383294.111515:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363f98c000 for lustre-OST0000 00000100:00100000:2.0:1787383294.111947:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984864000 00000100:00100000:2.0:1787383294.111957:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984864000 00000100:00100000:2.0:1787383294.112015:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787383294.112025:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984864000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787383294.112060:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787383294.112140:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984864000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (4856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383294.112146:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787383294.112210:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984864000:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787383294.619863:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383295.134996:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383295.135032:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984864512:0@lo:400:kworker.0 00000100:00100000:1.0:1787383295.135068:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984864256:0@lo:400:kworker.0 00000100:00100000:2.0:1787383295.135102:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383295.135133:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984864640:0@lo:400:kworker.0 00000100:00100000:1.0:1787383295.135186:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984864512 00000100:00100000:1.0:1787383295.135193:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984864512 00000100:00100000:1.0:1787383295.135246:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787383295.135255:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984864512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383295.135299:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984864512:12345-0@lo:400:kworker.0 Request processed in 45us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.135306:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787383295.135439:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984864512:0@lo:400:kworker.0 00000100:00100000:2.0:1787383295.135448:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984864128:0@lo:400:kworker.0 00000100:00100000:0.0:1787383295.135449:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383295.135475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383295.135477:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984865152:0@lo:400:kworker.0 00000100:00100000:0.0:1787383295.135500:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383295.135509:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984865024:0@lo:400:kworker.0 00000100:00100000:0.0:1787383295.135515:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984865664:0@lo:400:kworker.0 00000100:00100000:2.0:1787383295.135528:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383295.135550:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984865536:0@lo:400:kworker.0 00000100:00100000:0.0:1787383295.135550:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383295.135571:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383295.135597:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984864128 00000100:00100000:2.0:1787383295.135600:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984864128 00000100:00100000:0.0:1787383295.135624:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984865152 00000100:00100000:2.0:1787383295.135625:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787383295.135627:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984865152 00000100:00100000:2.0:1787383295.135636:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984864128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383295.135651:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984865024 00000100:00100000:0.0:1787383295.135654:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984865024 00000100:00100000:0.0:1787383295.135666:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984865664 00000100:00100000:0.0:1787383295.135668:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984865664 00000100:00100000:2.0:1787383295.135671:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984864128:12345-0@lo:400:kworker.0 Request processed in 36us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383295.135677:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787383295.135680:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984865536 00000100:00100000:0.0:1787383295.135682:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984865536 00000100:00100000:0.0:1787383295.135693:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787383295.135704:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787383295.135705:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984865152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383295.135709:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984865024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383295.135733:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984865024:12345-0@lo:400:kworker.0 Request processed in 23us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383295.135735:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984865152:12345-0@lo:400:kworker.0 Request processed in 31us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383295.135739:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787383295.135741:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787383295.135751:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787383295.135757:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984865664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383295.135805:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984864640 00000100:00100000:1.0:1787383295.135809:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984864640 00000100:00100000:1.0:1787383295.135835:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787383295.135841:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984864640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383295.135872:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984864640:12345-0@lo:400:kworker.0 Request processed in 32us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.135877:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787383295.135991:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787383295.135999:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984865536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383295.136028:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984865536:12345-0@lo:400:kworker.0 Request processed in 30us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383295.136033:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787383295.136060:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984864640:0@lo:400:kworker.0 00010000:00080000:0.0:1787383295.136070:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c60000 x1874206984865152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383295.136080:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984865152:0@lo:400:kworker.0 00000100:00100000:3.0:1787383295.136195:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984864384:0@lo:400:kworker.0 00000100:00100000:3.0:1787383295.136295:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383295.136360:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984864896:0@lo:400:kworker.0 00000100:00100000:3.0:1787383295.136383:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383295.136401:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984865408:0@lo:400:kworker.0 00000100:00100000:3.0:1787383295.136422:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383295.136453:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984864896 00000100:00100000:3.0:1787383295.136457:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984864896 00000100:00100000:3.0:1787383295.136616:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984865408 00000100:00100000:3.0:1787383295.136620:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984865408 00000100:00100000:2.0:1787383295.136632:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984865664:12345-0@lo:400:kworker.0 Request processed in 875us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383295.136639:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787383295.136666:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383295.136684:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984864768:0@lo:400:kworker.0 00000100:00100000:2.0:1787383295.136705:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383295.136714:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984865280:0@lo:400:kworker.0 00000100:00100000:2.0:1787383295.136728:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383295.136745:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984864256 00000100:00100000:2.0:1787383295.136748:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984864256 00000100:00100000:2.0:1787383295.136761:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984864768 00000100:00100000:3.0:1787383295.136805:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984865280 00000100:00100000:3.0:1787383295.136809:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984865280 00000100:00100000:3.0:1787383295.136849:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787383295.136857:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984864896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383295.136883:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984864768 00000100:00100000:3.0:1787383295.136892:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984864896:12345-0@lo:400:kworker.0 Request processed in 37us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.136898:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787383295.136907:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787383295.136910:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787383295.136912:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984864256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383295.136924:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984865408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383295.136945:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984865408:12345-0@lo:400:kworker.0 Request processed in 22us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383295.136945:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984864256:12345-0@lo:400:kworker.0 Request processed in 32us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.136950:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787383295.136956:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787383295.136961:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787383295.136965:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787383295.136966:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984865280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383295.136970:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984864768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383295.136989:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984865280:12345-0@lo:400:kworker.0 Request processed in 23us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383295.136991:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984864768:12345-0@lo:400:kworker.0 Request processed in 21us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.136995:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787383295.136998:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:3.0:1787383295.137009:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383295.137013:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787383295.137016:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383295.137018:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383295.137019:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984864256:0@lo:400:kworker.0 00000100:00100000:2.0:1787383295.137028:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984864768:0@lo:400:kworker.0 00000100:00100000:2.0:1787383295.137104:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984865280:0@lo:400:kworker.0 00010000:00080000:2.0:1787383295.137137:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c63b80 x1874206984865024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383295.137148:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984865024:0@lo:400:kworker.0 00010000:00080000:2.0:1787383295.137177:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c62680 x1874206984865536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383295.137184:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984865536:0@lo:400:kworker.0 00000100:00100000:2.0:1787383295.137192:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984864128:0@lo:400:kworker.0 00010000:00080000:2.0:1787383295.137216:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c60700 x1874206984865664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383295.137225:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984865664:0@lo:400:kworker.0 00000100:00100000:1.0:1787383295.140792:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984864384 00000100:00100000:1.0:1787383295.140806:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984864384 00000100:00100000:1.0:1787383295.140855:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787383295.140863:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984864384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383295.140943:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984864384:12345-0@lo:400:kworker.0 Request processed in 81us (4648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.140950:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787383295.144454:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984864384:0@lo:400:kworker.0 00010000:00080000:3.0:1787383295.144475:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c61500 x1874206984864896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383295.144486:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984864896:0@lo:400:kworker.0 00010000:00080000:3.0:1787383295.144497:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c60380 x1874206984865408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383295.144506:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984865408:0@lo:400:kworker.0 00000020:00000080:3.0:1787383295.454720:0:13185:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffeffcb73d0 00000020:00000080:3.0:1787383295.454734:0:13185:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787383295.454739:0:13185:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787383295.454746:0:13185:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeffcb9660 20000000:00000080:3.0:1787383295.454752:0:13185:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96363da90400 uarg=0000000000000000 20000000:01000000:3.0:1787383295.454960:0:13185:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787383295.454971:0:13185:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787383295.454975:0:13185:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787383295.457821:0:13186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787383295.458078:0:13185:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787383295.471454:0:13185:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787383295.471722:0:13185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.471758:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636013fd800/0xc40acec91532e551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402600 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.471784:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96363dac9600/0xc40acec91532e55f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e558 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.471791:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963601654600/0xc40acec91532e56d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e566 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.471798:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636102b6800/0xc40acec91532e57b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e574 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.471805:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963601654e00/0xc40acec91532e589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e582 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.471812:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636102b7e00/0xc40acec91532e59e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340263f expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.471819:0:13185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.471860:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636102b7e00/0xc40acec91532e59e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340263f expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.471872:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636102b7e00/0xc40acec91532e59e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340263f expref: 12 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383295.471884:0:13185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1874206984865792:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383295.471981:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963601654e00/0xc40acec91532e589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e582 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.471996:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff963601654e00/0xc40acec91532e589 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e582 expref: 23 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383295.472005:0:13185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1874206984865920:0@lo:104: 00000100:00100000:2.0:1787383295.472046:0:13185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383295.472080:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636102b6800/0xc40acec91532e57b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e574 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.472088:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636102b6800/0xc40acec91532e57b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e574 expref: 23 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383295.472096:0:13185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1874206984866048:0@lo:104: 00000100:00100000:2.0:1787383295.472116:0:13185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383295.472135:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963601654600/0xc40acec91532e56d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e566 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.472143:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff963601654600/0xc40acec91532e56d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e566 expref: 23 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383295.472230:0:10396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984865920 00000100:00100000:2.0:1787383295.472233:0:13185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1874206984866176:0@lo:104: 00000100:00100000:3.0:1787383295.472237:0:10396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984865920 00000100:00100000:2.0:1787383295.472255:0:13185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383295.472272:0:10396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984866048 00000100:00100000:3.0:1787383295.472274:0:10396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984866048 00010000:00010000:2.0:1787383295.472278:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96363dac9600/0xc40acec91532e55f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e558 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383295.472286:0:10396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984866176 00010000:00010000:2.0:1787383295.472287:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96363dac9600/0xc40acec91532e55f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e558 expref: 23 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383295.472288:0:10396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984866176 00000100:00100000:2.0:1787383295.472295:0:13185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1874206984866304:0@lo:104: 00000100:00100000:3.0:1787383295.472298:0:10396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787383295.472305:0:10396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+5:13185:x1874206984865920:12345-0@lo:104: 00010000:00010000:3.0:1787383295.472315:0:10396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e589 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383295.472320:0:13185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383295.472336:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636013fd800/0xc40acec91532e551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402600 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.472344:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636013fd800/0xc40acec91532e551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402600 expref: 12 pid: 6514 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383295.472352:0:13185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1874206984866432:192.168.203.2@tcp:104: 00010000:00010000:3.0:1787383295.472356:0:10396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787383295.472362:0:10396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+5:13185:x1874206984865920:12345-0@lo:104: Request processed in 57us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.472368:0:10396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787383295.472373:0:13185:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503e7bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383295.472383:0:10396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984866304 00000100:00100000:3.0:1787383295.472385:0:10396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984866304 00000100:00100000:2.0:1787383295.472392:0:13185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1874206984865920:0@lo:104: 00000100:00100000:3.0:1787383295.472396:0:10396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787383295.472401:0:10396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+5:13185:x1874206984866048:12345-0@lo:104: 00010000:00010000:3.0:1787383295.472407:0:10396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e57b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383295.472425:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787383295.472433:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+5:13185:x1874206984866176:12345-0@lo:104: 00010000:00010000:3.0:1787383295.472440:0:10396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1787383295.472441:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e56d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383295.472444:0:10396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+5:13185:x1874206984866048:12345-0@lo:104: Request processed in 44us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.472450:0:10396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787383295.472467:0:10396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1787383295.472467:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787383295.472471:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:68140aec-1198-480f-b348-a4187c7bb1d1+4:13185:x1874206984866176:12345-0@lo:104: Request processed in 41us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.472473:0:10396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+4:13185:x1874206984866304:12345-0@lo:104: 00000100:00100000:2.0:1787383295.472477:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:3.0:1787383295.472479:0:10396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e55f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472504:0:10396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787383295.472509:0:10396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+3:13185:x1874206984866304:12345-0@lo:104: Request processed in 37us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.472515:0:10396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1787383295.472529:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787383295.472534:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e589 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472541:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7400 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383295.472546:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e589 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472554:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e589 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383295.472561:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e589 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383295.472567:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383295.472594:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e589 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472600:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383295.472618:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e589 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472635:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e582 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e589 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472646:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787383295.472649:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e57b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472654:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7600 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383295.472657:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e57b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472663:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e57b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383295.472668:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e57b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383295.472673:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383295.472686:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e57b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472692:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383295.472698:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e57b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472704:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b7600/0xc40acec91532e574 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e57b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472711:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383295.472718:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e56d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472723:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383295.472726:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e56d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472732:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e56d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383295.472738:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e56d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383295.472742:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383295.472754:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e56d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.472759:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383295.474525:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e56d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.474539:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e566 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e56d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.474554:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383295.474558:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e55f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.474564:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655400 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383295.474567:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e55f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.474594:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e55f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383295.474600:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e55f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383295.474605:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383295.474638:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e55f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.474645:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383295.474655:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e55f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.474661:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e558 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e55f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.474675:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383295.474676:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383295.474678:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383295.474690:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383295.474707:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984866560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383295.474760:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383295.474813:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383295.474820:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984866688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383295.474839:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383295.474867:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984866816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383295.474887:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383295.474912:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383295.474918:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984866944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383295.474938:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383295.474975:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984866560 00000100:00100000:3.0:1787383295.474981:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984866560 00010000:00010000:3.0:1787383295.475014:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963601654e00/0xc40acec91532e589 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e582 expref: 24 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383295.475035:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984866688 00000100:00100000:3.0:1787383295.475038:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984866688 00010000:00010000:3.0:1787383295.475048:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636102b6800/0xc40acec91532e57b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e574 expref: 25 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383295.475056:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984866816 00000100:00100000:3.0:1787383295.475058:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984866816 00010000:00010000:3.0:1787383295.475066:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963601654600/0xc40acec91532e56d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e566 expref: 26 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383295.475073:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984866944 00000100:00100000:3.0:1787383295.475075:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984866944 00010000:00010000:3.0:1787383295.475083:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96363dac9600/0xc40acec91532e55f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e558 expref: 27 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383295.475094:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787383295.475101:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+27:3649:x1874206984866560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383295.475112:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383295.475117:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963601654e00/0xc40acec91532e589 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e582 expref: 27 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.475126:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963601654e00/0xc40acec91532e589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e582 expref: 27 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.475161:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963601654e00/0xc40acec91532e589 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e582 expref: 27 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.475176:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383295.475207:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+26:3649:x1874206984866560:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.475215:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787383295.475230:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787383295.475236:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+25:3649:x1874206984866688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383295.475243:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383295.475247:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636102b6800/0xc40acec91532e57b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e574 expref: 25 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.475254:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636102b6800/0xc40acec91532e57b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e574 expref: 25 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.475263:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383295.475281:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+25:3649:x1874206984866688:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.475287:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787383295.475297:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787383295.475302:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984866816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383295.475309:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383295.475313:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963601654600/0xc40acec91532e56d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e566 expref: 24 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.475320:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963601654600/0xc40acec91532e56d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e566 expref: 24 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.475334:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383295.475357:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984866816:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.475362:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787383295.475373:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787383295.475378:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+23:3647:x1874206984866944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383295.475386:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383295.475390:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96363dac9600/0xc40acec91532e55f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e558 expref: 23 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.475397:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96363dac9600/0xc40acec91532e55f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e558 expref: 23 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383295.475405:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383295.475423:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+23:3647:x1874206984866944:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383295.475428:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787383295.475470:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984866944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383295.475479:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984866816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383295.475501:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984866688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383295.475509:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984866560:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383295.475908:0:13185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b6800/0xc40acec91532e57b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e574 expref: 22 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383295.475918:0:13185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1874206984866048:0@lo:104: 00010000:00010000:0.0:1787383295.475928:0:13185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963601654600/0xc40acec91532e56d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e566 expref: 21 pid: 6512 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383295.475935:0:13185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1874206984866176:0@lo:104: 00010000:00010000:0.0:1787383295.475943:0:13185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac9600/0xc40acec91532e55f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e558 expref: 20 pid: 6514 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383295.475949:0:13185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1874206984866304:0@lo:104: 00000100:00100000:3.0:1787383295.480620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383295.480690:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383295.480754:0:13185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1874206984865792:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383295.480787:0:13185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1874206984866432:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383295.480823:0:13185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383295.482672:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965909632 00000100:00100000:2.0:1787383295.482687:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965909632 00000100:00100000:1.0:1787383295.482715:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965909760 00000100:00100000:1.0:1787383295.482719:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965909760 00010000:00010000:2.0:1787383295.482731:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636102b7e00/0xc40acec91532e59e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340263f expref: 14 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.482736:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636013fd800/0xc40acec91532e551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402600 expref: 14 pid: 6514 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383295.482830:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:1.0:1787383295.482840:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+14:2402:x1874206965909760:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383295.482868:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383295.482874:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636013fd800/0xc40acec91532e551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402600 expref: 14 pid: 6514 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.482883:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636013fd800/0xc40acec91532e551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402600 expref: 14 pid: 6514 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.482901:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636013fd800/0xc40acec91532e551 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402600 expref: 14 pid: 6514 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.482917:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383295.482942:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:2.0:1787383295.482950:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2402:x1874206965909632:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383295.482958:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383295.482963:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636102b7e00/0xc40acec91532e59e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340263f expref: 13 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.482978:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636102b7e00/0xc40acec91532e59e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340263f expref: 13 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383295.482980:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2402:x1874206965909760:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 142us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.482988:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00010000:00010000:2.0:1787383295.482989:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b7e00/0xc40acec91532e59e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340263f expref: 13 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.483001:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.483009:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.483025:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.483032:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.483039:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.483045:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.483050:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383295.483055:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.483063:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.484298:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383295.484316:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383295.484407:0:13185:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.484416:0:13185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383295.484422:0:13185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9800/0xc40acec91532e5c1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383295.484841:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:2402:x1874206965909632:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1887us (4225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383295.484850:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00010000:00010000:1.0:1787383295.643036:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383295.643901:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984867072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383295.644014:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383295.651940:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984867072 00000100:00100000:1.0:1787383295.651954:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984867072 00000100:00100000:1.0:1787383295.652033:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787383295.652045:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984867072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383295.652074:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383295.652166:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984867072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (8152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.652174:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1787383295.652219:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c60380 x1874206984867072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383295.652237:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984867072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383295.667715:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984867200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383295.667798:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383295.667846:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984867200 00000100:00100000:1.0:1787383295.667853:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984867200 00000100:00100000:1.0:1787383295.667904:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787383295.667914:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984867200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787383295.667935:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383295.667986:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984867200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383295.667994:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1787383295.668025:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c60380 x1874206984867200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383295.668054:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984867200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383296.155040:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984867328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383296.155521:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383296.156876:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984867328 00000100:00100000:1.0:1787383296.156888:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984867328 00000100:00100000:1.0:1787383296.156947:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787383296.156957:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984867328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383296.156990:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787383296.157101:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984867328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383296.157108:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787383296.159735:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984867328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383296.669524:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984867456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383296.669606:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383296.669742:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984867456 00000100:00100000:2.0:1787383296.669750:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984867456 00000100:00100000:2.0:1787383296.669834:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787383296.669848:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984867456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787383296.669876:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383296.669920:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984867456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383296.669927:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787383296.669950:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984867584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383296.669975:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383296.670518:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984867584 00000100:00100000:1.0:1787383296.670524:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984867584 00000100:00100000:1.0:1787383296.670548:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787383296.670555:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984867584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383296.670581:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383296.670616:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984867584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383296.670622:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00010000:1.0:1787383296.670757:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1787383296.674935:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963622ea9c00 x1874206984867456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383296.674966:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984867456:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787383296.679043:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963502017b80 x1874206984867584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383296.679070:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984867584:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1787383296.923133:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787383296.923150:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96350233b000 from 7 10000000:01000000:1.0:1787383296.923156:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787383296.923203:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923215:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.923226:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383296.923253:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984867712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787383296.923328:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383296.923404:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397240 going to sleep for 11 seconds 00000100:00100000:2.0:1787383296.923625:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984867712 00000100:00100000:2.0:1787383296.923842:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984867712 00000100:00100000:2.0:1787383296.923889:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1787383296.923897:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984867712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383296.923910:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383296.923925:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c8e00/0xc40acec91532e5cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e5c8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.923947:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c8e00/0xc40acec91532e5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e5c8 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.924165:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c8e00/0xc40acec91532e5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e5c8 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.924176:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8e00, rc 0) 00000100:00100000:2.0:1787383296.924224:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984867712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 328us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383296.924231:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787383296.924366:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984867712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383296.924381:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e5cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.924389:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e5cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383296.924455:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984867840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383296.924483:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383296.924550:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397240 going to sleep for 11 seconds 00000100:00100000:2.0:1787383296.925060:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984867840 00000100:00100000:2.0:1787383296.925066:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984867840 00000100:00100000:3.0:1787383296.925279:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787383296.925288:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984867840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383296.925427:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984867840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383296.925433:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787383296.925501:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984867840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383296.925534:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984867968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383296.925577:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383296.926040:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397240 going to sleep for 11 seconds 00000100:00100000:0.0:1787383296.926219:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984867968 00000100:00100000:0.0:1787383296.926225:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984867968 00000100:00100000:0.0:1787383296.926251:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787383296.926257:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984867968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383296.926449:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984867968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383296.926456:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787383296.926559:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984867968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787383296.930533:0:13216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787383296.934272:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787383296.934366:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383296.934378:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e5cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383296.934391:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e5cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383296.934402:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383296.934405:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96363d95c800 from 7 10000000:01000000:3.0:1787383296.934408:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383296.934447:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383296.934455:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383296.934483:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383296.934509:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383296.934572:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383296.934974:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636064c6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787383296.935080:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984868096 00000100:00100000:0.0:1787383296.935088:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984868096 00000100:00100000:0.0:1787383296.935184:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787383296.935193:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984868096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383296.935206:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383296.935219:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96363dac8200/0xc40acec91532e5dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e5d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.935242:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac8200/0xc40acec91532e5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e5d6 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.935252:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96363dac8200/0xc40acec91532e5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e5d6 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383296.935273:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac8200, rc 0) 00000100:00100000:0.0:1787383296.935387:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984868096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383296.935394:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787383296.935463:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383296.935478:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e5dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.935487:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e5dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383296.935547:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383296.935574:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383296.936280:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383296.936425:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984868224 00000100:00100000:3.0:1787383296.936432:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984868224 00000100:00100000:3.0:1787383296.936461:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787383296.936467:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984868224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383296.936835:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984868224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383296.936844:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787383296.937159:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383296.937201:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383296.937251:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383296.937292:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383296.937455:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984868352 00000100:00100000:3.0:1787383296.937459:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984868352 00000100:00100000:3.0:1787383296.937495:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787383296.937502:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984868352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383296.937599:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984868352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383296.937607:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1787383296.937995:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787383296.939451:0:13217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787383296.940218:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787383296.940244:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383296.940255:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e5dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383296.940266:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e5dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383296.940289:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383296.940291:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9636183cf000 from 7 10000000:01000000:3.0:1787383296.940294:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383296.940395:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383296.940404:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383296.940413:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383296.940437:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383296.940494:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383296.940536:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636064c69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383296.940595:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984868480 00000100:00100000:1.0:1787383296.940602:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984868480 00000100:00100000:1.0:1787383296.940655:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1787383296.940663:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984868480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383296.940675:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383296.940686:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c0e00/0xc40acec91532e5eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e5e4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.940707:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0e00/0xc40acec91532e5eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e5e4 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.941065:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c0e00/0xc40acec91532e5eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e5e4 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.941076:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0e00, rc 0) 00000100:00100000:1.0:1787383296.941125:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984868480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 462us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383296.941132:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787383296.941217:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383296.941230:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e5eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383296.941240:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e5eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383296.941295:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383296.941391:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383296.941408:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636064c69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383296.941467:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984868608 00000100:00100000:2.0:1787383296.941471:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984868608 00000100:00100000:2.0:1787383296.941502:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1787383296.941509:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984868608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383296.941639:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984868608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383296.941646:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787383296.943480:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383296.943540:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383296.943619:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383296.943662:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636113979c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383296.943928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984868736 00000100:00100000:2.0:1787383296.943935:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984868736 00000100:00100000:2.0:1787383296.944315:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787383296.944333:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984868736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383296.944464:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984868736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383296.944473:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787383296.944566:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787383296.945264:0:13218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787383296.945329:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787383296.945345:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383296.945356:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e5eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383296.945367:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e5eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383296.945378:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383296.945380:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9636064d1800 from 7 10000000:01000000:3.0:1787383296.945383:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383296.945410:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383296.945418:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383296.945426:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383296.945444:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383296.945498:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383296.953990:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636064c6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383296.957188:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984868864 00000100:00100000:1.0:1787383296.957202:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984868864 00000100:00100000:1.0:1787383296.957264:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787383296.957273:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984868864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383296.957289:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383296.957367:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c0200/0xc40acec91532e5f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e5f2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.957395:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0200/0xc40acec91532e5f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e5f2 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.957407:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c0200/0xc40acec91532e5f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e5f2 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383296.957416:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0200, rc 0) 00000100:00100000:1.0:1787383296.957495:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984868864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (11996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383296.957502:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787383296.960069:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383296.960094:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e5f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.960106:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e5f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383296.960197:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502017480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383296.960252:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383296.960290:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503e7b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383296.962410:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984868992 00000100:00100000:1.0:1787383296.962422:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984868992 00000100:00100000:1.0:1787383296.962467:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787383296.962476:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984868992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383296.962708:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984868992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (2453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383296.962716:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1787383296.965063:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502017480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984868992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383296.965123:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502017480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984869120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383296.965198:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383296.965264:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503e7b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787383296.973533:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984869120 00000100:00100000:3.0:1787383296.973547:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984869120 00000100:00100000:3.0:1787383296.978090:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787383296.978109:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984869120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383296.978277:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984869120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (13079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383296.978285:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787383296.983397:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502017480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984869120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787383296.985225:0:13223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787383296.985290:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787383296.985320:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383296.985332:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e5f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383296.985344:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e5f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383297.076405:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383297.076569:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965909888 00000100:00100000:1.0:1787383297.076578:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965909888 00000100:00100000:1.0:1787383297.076633:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 324 00000100:00100000:1.0:1787383297.076643:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:6173:x1874206965909888:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383297.076659:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383297.076688:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c1400/0xc40acec91532e600 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402670 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.076726:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c1400/0xc40acec91532e600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402670 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.076744:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c1400/0xc40acec91532e600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402670 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.076755:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1400, rc 0) 00000100:00100000:1.0:1787383297.076836:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:6173:x1874206965909888:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 194us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383297.076845:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 324 00000100:00100000:2.0:1787383297.085427:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383297.085471:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965910016 00000100:00100000:2.0:1787383297.085481:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965910016 00000100:00100000:2.0:1787383297.085534:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 325 00000100:00100000:2.0:1787383297.085556:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:6173:x1874206965910016:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383297.086094:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:6173:x1874206965910016:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 538us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.086103:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 325 00000100:00100000:1.0:1787383297.094968:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383297.095618:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965910144 00000100:00100000:2.0:1787383297.095629:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965910144 00000100:00100000:2.0:1787383297.095693:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 326 00000100:00100000:2.0:1787383297.095703:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:6173:x1874206965910144:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383297.096190:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:6173:x1874206965910144:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 487us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.096198:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 326 00000100:00100000:1.0:1787383297.105733:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383297.105790:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965910272 00000100:00100000:1.0:1787383297.105800:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965910272 00000100:00100000:1.0:1787383297.105848:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 327 00000100:00100000:1.0:1787383297.105858:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:6173:x1874206965910272:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383297.105875:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383297.105892:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c1e00/0xc40acec91532e607 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402677 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.105918:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c1e00/0xc40acec91532e607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402677 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.105930:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c1e00/0xc40acec91532e607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402677 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383297.105953:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1e00, rc 0) 00000100:00100000:1.0:1787383297.105998:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:6173:x1874206965910272:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 141us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383297.106005:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 327 00000100:00100000:2.0:1787383297.109197:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383297.113619:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965910400 00000100:00100000:1.0:1787383297.113633:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965910400 00000100:00100000:1.0:1787383297.113971:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 328 00000100:00100000:1.0:1787383297.113984:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:6173:x1874206965910400:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383297.114210:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:6173:x1874206965910400:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 159us (4951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383297.114221:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 328 00000100:00100000:1.0:1787383297.123874:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383297.124105:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965910528 00000100:00100000:2.0:1787383297.124115:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965910528 00000100:00100000:2.0:1787383297.124181:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 329 00000100:00100000:2.0:1787383297.124191:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:6173:x1874206965910528:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383297.124321:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:6173:x1874206965910528:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 131us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383297.124329:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 329 00010000:00010000:1.0:1787383297.691088:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383298.103611:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383298.103652:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383298.103680:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383298.103699:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383298.103719:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383298.103744:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965910784 00000100:00100000:0.0:1787383298.103753:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965910784 00000100:00100000:0.0:1787383298.103826:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965911040 00000100:00100000:0.0:1787383298.103830:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965911040 00000100:00100000:0.0:1787383298.103844:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965910912 00000100:00100000:0.0:1787383298.103846:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965910912 00000100:00100000:0.0:1787383298.103856:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965911168 00000100:00100000:0.0:1787383298.103859:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965911168 00000100:00100000:0.0:1787383298.103874:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 183 00000100:00100000:0.0:1787383298.103882:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2401:x1874206965910784:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383298.103953:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2401:x1874206965910784:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 70us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383298.103961:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 183 00000100:00100000:0.0:1787383298.103977:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 184 00000100:00100000:0.0:1787383298.103983:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206965911040:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383298.104008:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206965911040:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383298.104029:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 184 00000100:00100000:0.0:1787383298.104041:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 185 00000100:00100000:0.0:1787383298.104048:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965910912:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383298.104073:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965910912:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383298.104079:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 185 00000100:00100000:0.0:1787383298.104090:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 186 00000100:00100000:0.0:1787383298.104096:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206965911168:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383298.104118:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206965911168:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383298.104124:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 186 00000100:00100000:0.0:1787383298.104153:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965910656 00000100:00100000:0.0:1787383298.104156:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965910656 00000100:00100000:0.0:1787383298.104179:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 330 00000100:00100000:0.0:1787383298.104184:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2401:x1874206965910656:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383298.104207:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2401:x1874206965910656:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383298.104213:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 330 00000100:00080000:2.0:1787383298.108611:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383298.108629:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787383298.716654:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383299.234597:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383299.234623:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984869248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787383299.234691:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383299.234757:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984869248 00000100:00100000:1.0:1787383299.234782:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984869248 00000100:00100000:1.0:1787383299.234826:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787383299.234834:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984869248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383299.234866:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383299.234905:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984869248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383299.234912:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787383299.234969:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984869248:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787383299.664917:0:13383:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787383299.740415:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383300.251136:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984869760:0@lo:400:kworker.0 00000100:00100000:0.0:1787383300.251177:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984869632:0@lo:400:kworker.0 00000100:00100000:2.0:1787383300.251210:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383300.251219:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383300.251284:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984869504:0@lo:400:kworker.0 00000100:00100000:2.0:1787383300.251296:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984870272:0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.251317:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383300.251332:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383300.251341:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984870016:0@lo:400:kworker.0 00000100:00100000:2.0:1787383300.251359:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984870784:0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.251367:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383300.251391:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383300.251397:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984870528:0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.251423:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383300.251447:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984869760 00000100:00100000:1.0:1787383300.251453:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787383300.251456:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984869760 00000100:00100000:1.0:1787383300.251462:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984869376:0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.251500:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383300.251501:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984869504 00000100:00100000:2.0:1787383300.251506:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984869504 00000100:00100000:2.0:1787383300.251526:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984870016 00000100:00100000:1.0:1787383300.251528:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984869888:0@lo:400:kworker.0 00000100:00100000:2.0:1787383300.251531:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984870016 00000100:00100000:1.0:1787383300.251553:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383300.251559:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984870528 00000100:00100000:2.0:1787383300.251564:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984870528 00000100:00100000:1.0:1787383300.251575:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984870400:0@lo:400:kworker.0 00000100:00100000:2.0:1787383300.251585:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787383300.251594:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984869760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.251603:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383300.251622:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984870912:0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.251651:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383300.251663:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984869760:12345-0@lo:400:kworker.0 Request processed in 69us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383300.251672:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787383300.251692:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787383300.251699:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984869504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.251715:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984869632 00000100:00100000:1.0:1787383300.251721:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984869632 00000100:00100000:2.0:1787383300.251738:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984869504:12345-0@lo:400:kworker.0 Request processed in 38us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383300.251746:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984869888 00000100:00100000:2.0:1787383300.251747:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787383300.251752:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984869888 00000100:00100000:2.0:1787383300.251795:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787383300.251798:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787383300.251807:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984870016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.251809:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984869632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.251847:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984869632:12345-0@lo:400:kworker.0 Request processed in 41us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383300.251866:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984870016:12345-0@lo:400:kworker.0 Request processed in 61us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383300.251868:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787383300.251878:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787383300.251891:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787383300.251898:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787383300.251902:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984869888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383300.251911:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984870528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.251944:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984869888:12345-0@lo:400:kworker.0 Request processed in 45us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383300.251951:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787383300.251957:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984870528:12345-0@lo:400:kworker.0 Request processed in 47us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383300.251966:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787383300.251987:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984870272 00000100:00100000:1.0:1787383300.251992:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984870272 00000100:00100000:2.0:1787383300.251996:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984870784 00000100:00100000:2.0:1787383300.252001:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984870784 00000100:00100000:1.0:1787383300.252016:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984870400 00000100:00100000:1.0:1787383300.252021:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984870400 00000100:00100000:2.0:1787383300.252027:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984870912 00000100:00100000:2.0:1787383300.252032:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984870912 00000100:00100000:1.0:1787383300.252044:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787383300.252054:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984870272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383300.252060:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787383300.252070:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984870784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.252088:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502014a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984870272:12345-0@lo:400:kworker.0 Request processed in 35us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383300.252095:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787383300.252111:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787383300.252127:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984870784:12345-0@lo:400:kworker.0 Request processed in 46us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383300.252134:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984870400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383300.252140:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787383300.252158:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787383300.252166:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984870912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.252172:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984870400:12345-0@lo:400:kworker.0 Request processed in 40us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383300.252180:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787383300.252202:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984870912:12345-0@lo:400:kworker.0 Request processed in 37us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383300.252209:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1787383300.252221:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383300.252226:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383300.252230:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787383300.252262:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cd1180 x1874206984870272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383300.252275:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984870272:0@lo:400:kworker.0 00010000:00080000:2.0:1787383300.252288:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f995f80 x1874206984870784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383300.252304:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984870784:0@lo:400:kworker.0 00000100:00100000:2.0:1787383300.252320:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984869760:0@lo:400:kworker.0 00000100:00100000:3.0:1787383300.252321:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984869376 00000100:00100000:3.0:1787383300.252327:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984869376 00000100:00100000:2.0:1787383300.252365:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984869888:0@lo:400:kworker.0 00000100:00100000:3.0:1787383300.252369:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787383300.252380:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984869376:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787383300.252382:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cd0000 x1874206984870400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383300.252395:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984870400:0@lo:400:kworker.0 00010000:00080000:2.0:1787383300.252409:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f994000 x1874206984870912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383300.252418:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984870912:0@lo:400:kworker.0 00000100:00100000:3.0:1787383300.252420:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984869376:12345-0@lo:400:kworker.0 Request processed in 42us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383300.252429:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787383300.252437:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984869504:0@lo:400:kworker.0 00000100:00100000:2.0:1787383300.252453:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984870016:0@lo:400:kworker.0 00000100:00100000:2.0:1787383300.252464:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984870528:0@lo:400:kworker.0 00000100:00100000:2.0:1787383300.252485:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984869376:0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.253212:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984869632:0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.253225:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984870144:0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.253262:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383300.253305:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984870656:0@lo:400:kworker.0 00000100:00100000:1.0:1787383300.253329:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383300.253673:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984870144 00000100:00100000:0.0:1787383300.253680:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984870144 00000100:00100000:0.0:1787383300.253744:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984870656 00000100:00100000:0.0:1787383300.253747:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984870656 00000100:00100000:0.0:1787383300.253799:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787383300.253807:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984870144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383300.253853:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984870144:12345-0@lo:400:kworker.0 Request processed in 47us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383300.253859:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787383300.253871:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787383300.253877:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984870656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383300.253902:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984870656:12345-0@lo:400:kworker.0 Request processed in 25us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383300.253908:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00010000:00080000:0.0:1787383300.253936:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cd3b80 x1874206984870144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383300.253946:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984870144:0@lo:400:kworker.0 00010000:00080000:0.0:1787383300.253955:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636409a4380 x1874206984870656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383300.253964:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984870656:0@lo:400:kworker.0 00000100:00080000:1.0:1787383300.254129:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787383300.763888:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383300.763989:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383300.764007:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984871040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383300.764063:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383300.764127:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984871040 00000100:00100000:3.0:1787383300.764134:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984871040 00000100:00100000:3.0:1787383300.764185:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787383300.764194:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984871040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383300.764220:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383300.764255:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984871040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383300.764263:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1787383300.764298:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963622ea8a80 x1874206984871040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383300.764313:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984871040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383300.764959:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984871168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383300.764995:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383300.766143:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984871168 00000100:00100000:2.0:1787383300.766944:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984871168 00000100:00100000:2.0:1787383300.767003:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787383300.767013:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984871168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787383300.767039:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383300.767121:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984871168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (2116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383300.767146:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1787383300.767909:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c60a80 x1874206984871168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383300.767931:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984871168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383301.277075:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383301.277098:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984871296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383301.277174:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383301.277251:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984871296 00000100:00100000:3.0:1787383301.277267:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984871296 00000100:00100000:3.0:1787383301.277352:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787383301.277374:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984871296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787383301.277422:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787383301.277515:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984871296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383301.277523:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787383301.277813:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984871296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383301.786986:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984871552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383301.786997:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984871424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383301.787066:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383301.787148:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984871552 00000100:00100000:3.0:1787383301.787156:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984871552 00000100:00100000:1.0:1787383301.787182:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383301.787200:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984871424 00000100:00100000:3.0:1787383301.787204:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984871424 00000100:00100000:3.0:1787383301.787225:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787383301.787234:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984871552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787383301.787262:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383301.787312:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984871552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383301.787319:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787383301.787336:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787383301.787341:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984871424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383301.787352:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383301.787381:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984871424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383301.787388:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1787383301.787429:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503c60a80 x1874206984871424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383301.787446:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984871424:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787383301.787546:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963622ea8a80 x1874206984871552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383301.787562:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984871552:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787383301.791152:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383302.813974:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383303.221846:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383303.221892:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383303.221928:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383303.221943:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965911296 00000100:00100000:2.0:1787383303.221958:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965911296 00000100:00100000:1.0:1787383303.221967:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383303.222002:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383303.222031:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 332 00000100:00100000:1.0:1787383303.222035:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965911552 00000100:00100000:1.0:1787383303.222041:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965911552 00000100:00100000:2.0:1787383303.222047:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2403:x1874206965911296:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383303.222091:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965911808 00000100:00100000:1.0:1787383303.222105:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965911808 00000100:00100000:1.0:1787383303.222126:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965911424 00000100:00100000:1.0:1787383303.222129:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965911424 00000100:00100000:2.0:1787383303.222153:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2403:x1874206965911296:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 110us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383303.222163:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 332 00000100:00100000:1.0:1787383303.222168:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965911680 00000100:00100000:1.0:1787383303.222173:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965911680 00000100:00100000:1.0:1787383303.222195:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 193 00000100:00100000:1.0:1787383303.222204:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965911552:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383303.222248:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965911552:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 45us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383303.222255:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 193 00000100:00100000:1.0:1787383303.222272:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 194 00000100:00100000:1.0:1787383303.222279:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965911808:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383303.222306:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965911808:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383303.222312:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 194 00000100:00100000:1.0:1787383303.222325:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 195 00000100:00100000:1.0:1787383303.222331:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965911424:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383303.222359:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965911424:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383303.222365:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 195 00000100:00100000:1.0:1787383303.222376:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 196 00000100:00100000:1.0:1787383303.222382:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965911680:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383303.222407:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965911680:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383303.222412:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 196 00000100:00080000:1.0:1787383303.222435:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383303.222439:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787383303.837134:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383304.349173:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350377ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984871680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383304.349274:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383304.349956:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984871680 00000100:00100000:1.0:1787383304.349968:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984871680 00000100:00100000:1.0:1787383304.350036:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787383304.350047:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984871680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383304.350100:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383304.350177:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984871680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383304.350185:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787383304.350349:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350377ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984871680:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787383304.864189:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787383304.888466:0:13532:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:21:43 (1787383303) === 00000100:00100000:1.0:1787383305.166313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383305.166356:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965911936 00000100:00100000:1.0:1787383305.166367:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965911936 00000100:00100000:1.0:1787383305.166436:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:1.0:1787383305.166447:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2402:x1874206965911936:12345-192.168.203.2@tcp:41:mkdir.0 00000004:00000024:1.0:1787383305.166494:0:10098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787383305.166595:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2402:x1874206965911936:12345-192.168.203.2@tcp:41:mkdir.0 Request processed in 149us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383305.166604:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00080000:1.0:1787383305.166629:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383305.166668:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383305.166973:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965912064 00000100:00100000:1.0:1787383305.166978:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965912064 00000100:00100000:1.0:1787383305.167007:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:1.0:1787383305.167013:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:10506:x1874206965912064:12345-192.168.203.2@tcp:700:mkdir.0 00000100:00100000:1.0:1787383305.167129:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:10506:x1874206965912064:12345-192.168.203.2@tcp:700:mkdir.0 Request processed in 115us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383305.167137:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:1.0:1787383305.179379:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383305.179506:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965912320 00000100:00100000:3.0:1787383305.179519:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965912320 00000100:00100000:3.0:1787383305.179626:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:3.0:1787383305.179639:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:10506:x1874206965912320:12345-192.168.203.2@tcp:36:mkdir.0 00010000:00010000:3.0:1787383305.179711:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383305.182167:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532e4b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025eb expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.182217:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebf400) 00010000:00010000:3.0:1787383305.182249:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383305.182415:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e60e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.182429:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e60e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.182439:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e60e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.182465:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e615 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.182473:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e615 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.182480:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e615 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.183461:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e61c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.183477:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e61c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.183485:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e61c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383305.183500:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e815383 reply state 00000000d0892f43 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e61c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.183510:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e61c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.183517:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff963628ebf200) 00010000:00010000:3.0:1787383305.183520:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787383305.183524:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787383305.183531:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787383305.183538:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e60e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.183544:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e60e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.183552:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e60e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.183557:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383305.183563:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e60e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.183582:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e60e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.183593:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:3.0:1787383305.183595:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383305.183599:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e60e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.183605:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e60e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383305.183693:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009e815383 reply state 00000000d0892f43 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e615 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.183705:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e615 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.183712:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff963628ebf900) 00010000:00010000:3.0:1787383305.183714:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787383305.183717:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787383305.183903:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:10506:x1874206965912320:12345-192.168.203.2@tcp:36:mkdir.0 Request processed in 4265us (4579us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787383305.184022:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:1.0:1787383305.205255:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383305.205375:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965912448 00000100:00100000:3.0:1787383305.205389:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965912448 00000100:00100000:3.0:1787383305.205462:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:3.0:1787383305.205474:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:10507:x1874206965912448:12345-192.168.203.2@tcp:101:chmod.0 00010000:00010000:3.0:1787383305.205504:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383305.205536:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e623 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340267e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.205642:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e62a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.205659:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e62a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.205672:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e62a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383305.205730:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787383305.205734:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383305.205808:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e62a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.205840:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e623 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340267e expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.205863:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e62a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340267e expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.205873:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:3.0:1787383305.205876:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383305.205881:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b7e00, rc 0) 00000100:00100000:3.0:1787383305.205964:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:10507:x1874206965912448:12345-192.168.203.2@tcp:101:chmod.0 Request processed in 492us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383305.205973:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:1.0:1787383305.210977:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.212953:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965912704 00000100:00100000:2.0:1787383305.212974:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965912704 00000100:00100000:2.0:1787383305.213065:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:2.0:1787383305.213078:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+8:10507:x1874206965912704:12345-192.168.203.2@tcp:36:chmod.0 00010000:00010000:2.0:1787383305.213162:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383305.213202:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e62a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340267e expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.213226:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:2.0:1787383305.213239:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383305.213274:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e631 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.213289:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e631 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.213301:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e631 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383305.213590:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000105a1e28 reply state 0000000002677658 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e631 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.213604:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e631 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.213611:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350269ad00) 00010000:00010000:2.0:1787383305.213614:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787383305.213617:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787383305.213626:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787383305.213743:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+9:10507:x1874206965912704:12345-192.168.203.2@tcp:36:chmod.0 Request processed in 667us (2778us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787383305.213752:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:0.0:1787383305.247988:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383305.248137:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965912832 00000100:00100000:3.0:1787383305.248149:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965912832 00000100:00100000:3.0:1787383305.248294:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:3.0:1787383305.248306:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+9:10508:x1874206965912832:12345-192.168.203.2@tcp:101:chown.0 00010000:00010000:3.0:1787383305.248349:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383305.248377:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532e638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402685 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.248461:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7800/0xc40acec91532e63f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.248478:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7800/0xc40acec91532e63f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.248502:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7800/0xc40acec91532e63f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383305.248562:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787383305.248566:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383305.248620:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7800/0xc40acec91532e63f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.248651:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532e638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402685 expref: 11 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.248673:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7800/0xc40acec91532e63f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402685 expref: 10 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.248683:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350269ad00) 00010000:00010000:3.0:1787383305.248686:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383305.248690:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b7800, rc 0) 00000100:00100000:3.0:1787383305.248833:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+10:10508:x1874206965912832:12345-192.168.203.2@tcp:101:chown.0 Request processed in 528us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383305.248850:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:1.0:1787383305.264729:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.264905:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965912960 00000100:00100000:2.0:1787383305.264919:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965912960 00000100:00100000:2.0:1787383305.265000:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:2.0:1787383305.265012:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350377ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+10:10508:x1874206965912960:12345-192.168.203.2@tcp:101:chown.0 00010000:00010000:2.0:1787383305.265038:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383305.265064:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532e646 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340268c expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265160:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e64d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265179:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e64d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265192:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e64d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265228:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e654 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265235:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e654 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265242:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e654 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265343:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e65b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265352:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265359:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383305.265414:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787383305.265418:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383305.265443:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e65b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265457:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e64d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265464:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e64d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265470:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e64d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265486:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383305.265491:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e64d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265499:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e64d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265514:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350269ad00) 00010000:00010000:2.0:1787383305.265517:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383305.265522:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e64d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265528:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e64d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265543:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e654 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265549:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e654 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265554:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e654 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265559:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383305.265562:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e654 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265568:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e654 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265586:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff963628ebf900) 00010000:00010000:2.0:1787383305.265588:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383305.265592:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e654 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265598:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e654 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265630:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532e646 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340268c expref: 12 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265645:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e65b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340268c expref: 11 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.265652:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff963628ebf200) 00010000:00010000:2.0:1787383305.265654:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383305.265657:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9800, rc 0) 00000100:00100000:2.0:1787383305.265726:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350377ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+11:10508:x1874206965912960:12345-192.168.203.2@tcp:101:chown.0 Request processed in 717us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.265735:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:2.0:1787383305.271143:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383305.271894:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965913088 00000100:00100000:0.0:1787383305.271926:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965913088 00000100:00100000:0.0:1787383305.272004:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:0.0:1787383305.272016:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a75c5b6d-4c9e-4295-9df6-097efce92717+11:10508:x1874206965913088:12345-192.168.203.2@tcp:900:chown.0 00000100:00100000:0.0:1787383305.272152:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a75c5b6d-4c9e-4295-9df6-097efce92717+11:10508:x1874206965913088:12345-192.168.203.2@tcp:900:chown.0 Request processed in 137us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383305.272161:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:0.0:1787383305.280259:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.280385:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965913344 00000100:00100000:2.0:1787383305.280399:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965913344 00000100:00100000:2.0:1787383305.280478:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:2.0:1787383305.280490:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+11:10508:x1874206965913344:12345-192.168.203.2@tcp:36:chown.0 00010000:00010000:2.0:1787383305.280574:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383305.280613:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e65b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340268c expref: 11 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.280655:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff963628ebf200) 00010000:00010000:2.0:1787383305.280662:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383305.280693:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e662 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.280709:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e662 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.280720:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e662 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383305.285607:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1787383305.287481:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fde253c0 reply state 00000000e872928f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e662 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.287517:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e662 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.287530:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff963628ebf200) 00010000:00010000:2.0:1787383305.287534:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787383305.287540:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787383305.287557:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1787383305.287693:0:6520:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787383305.287719:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+9:10508:x1874206965913344:12345-192.168.203.2@tcp:36:chown.0 Request processed in 7225us (7470us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787383305.287729:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00010000:00010000:0.0:1787383305.287942:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e662 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383305.287959:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e662 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383305.287967:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e662 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383305.287972:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383305.287976:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e662 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383305.287982:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e662 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383305.287998:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff963628ebf200) 00010000:00010000:0.0:1787383305.288001:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787383305.288004:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e662 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383305.288009:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e662 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288527:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e615 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288537:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e615 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288543:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e615 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288548:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383305.288551:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e615 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288557:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e615 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288567:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff963628ebf900) 00010000:00010000:3.0:1787383305.288569:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383305.288572:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e615 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288577:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e615 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288594:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e61c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288867:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e61c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288895:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e61c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288901:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383305.288904:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e61c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288911:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e61c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288920:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff963628ebf200) 00010000:00010000:3.0:1787383305.288922:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383305.288925:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e61c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288931:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e61c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288949:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e631 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288956:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e631 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288961:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e631 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288965:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383305.288968:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e631 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288984:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e631 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.288993:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350269ad00) 00010000:00010000:3.0:1787383305.288995:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787383305.288998:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e631 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.289004:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e631 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383305.318580:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383305.318810:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965913472 00000100:00100000:3.0:1787383305.318820:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965913472 00000100:00100000:3.0:1787383305.318883:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:3.0:1787383305.318894:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:10510:x1874206965913472:12345-192.168.203.2@tcp:101:touch.500 00010000:00010000:0.0:1787383305.319193:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383305.319217:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9800/0xc40acec91532e669 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402693 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787383305.322271:0:9499:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3003us 00010000:00010000:2.0:1787383305.339311:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e670 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339331:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e670 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339355:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e670 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339373:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e677 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339380:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339386:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339506:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532e67e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339514:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532e67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339520:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532e67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383305.339546:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787383305.339549:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383305.339578:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532e67e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339588:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e670 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339595:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e670 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339611:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e670 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339618:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383305.339622:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e670 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339630:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e670 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339642:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350269ad00) 00010000:00010000:2.0:1787383305.339645:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383305.339649:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e670 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339654:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e670 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339666:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339673:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e677 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339678:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e677 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339683:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383305.339686:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e677 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339710:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e677 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339718:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96350269a400) 00010000:00010000:2.0:1787383305.339720:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383305.339723:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e677 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339729:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e677 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339801:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9800/0xc40acec91532e669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402693 expref: 8 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339816:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532e67e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402693 expref: 7 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.339823:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96350269ac00) 00010000:00010000:2.0:1787383305.339825:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787383305.339828:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9200, rc 0) 00000100:00100000:2.0:1787383305.339895:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:10510:x1874206965913472:12345-192.168.203.2@tcp:101:touch.500 Request processed in 21002us (21323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.339903:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:1.0:1787383305.346649:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.346720:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965913728 00000100:00100000:2.0:1787383305.346731:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965913728 00000100:00100000:2.0:1787383305.346824:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:2.0:1787383305.346835:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:10510:x1874206965913728:12345-192.168.203.2@tcp:101:touch.500 00010000:00010000:2.0:1787383305.346855:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383305.346888:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532e685 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340269a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.346997:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e68c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347011:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e68c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347033:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e68c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347278:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532e693 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347287:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532e693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347294:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532e693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787383305.347625:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787383305.347808:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532e69a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347818:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532e69a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347825:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532e69a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347857:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e68c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347875:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e68c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347883:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e68c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347888:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383305.347892:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e68c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347900:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e68c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347912:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96350269ac00) 00010000:00010000:2.0:1787383305.347916:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383305.347920:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e68c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347927:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e68c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383305.347939:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000068b3f1b reply state 00000000c807f264 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532e693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347949:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532e693 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.347954:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1ac77968 (ffff96350269a700) 00010000:00010000:2.0:1787383305.347956:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787383305.347959:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787383305.347991:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532e685 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340269a expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.348013:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532e69a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340269a expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.348741:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff96350269a500) 00010000:00010000:2.0:1787383305.348746:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383305.348749:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9000, rc 0) 00000100:00100000:2.0:1787383305.348986:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+10:10510:x1874206965913728:12345-192.168.203.2@tcp:101:touch.500 Request processed in 2151us (2343us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787383305.348995:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:0.0:1787383305.367151:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383305.369079:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965913984 00000100:00100000:1.0:1787383305.369103:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965913984 00000100:00100000:1.0:1787383305.369168:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:1.0:1787383305.369178:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+10:10510:x1874206965913984:12345-192.168.203.2@tcp:36:touch.500 00010000:00010000:1.0:1787383305.369236:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383305.369266:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532e69a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340269a expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383305.369288:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff96350269a500) 00010000:00010000:1.0:1787383305.369301:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383305.369358:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532e6a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383305.369372:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532e6a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383305.369381:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532e6a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383305.369486:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f70c3769 reply state 000000005a0d2ccc transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532e6a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383305.369497:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532e6a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383305.369521:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9635036bcc00) 00010000:00010000:1.0:1787383305.369523:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787383305.369526:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383305.369622:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+11:10510:x1874206965913984:12345-192.168.203.2@tcp:36:touch.500 Request processed in 445us (2480us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787383305.369630:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:2.0:1787383305.371360:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984871936:0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.371426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383305.371490:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984872448:0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.371514:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383305.371538:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984872960:0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.371582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383305.371609:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787383305.371616:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984872064:0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.371640:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383305.371658:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984872576:0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.371678:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383305.371698:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984873088:0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.371716:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383305.371741:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984871936 00000100:00100000:2.0:1787383305.371753:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984871936 00000100:00100000:2.0:1787383305.371823:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984872448 00000100:00100000:2.0:1787383305.371827:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984872448 00000100:00100000:2.0:1787383305.371850:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984872960 00000100:00100000:2.0:1787383305.371852:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984872960 00000100:00100000:2.0:1787383305.371862:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984872576 00000100:00100000:2.0:1787383305.371864:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984872576 00000100:00100000:2.0:1787383305.371874:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984873088 00000100:00100000:2.0:1787383305.371876:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984873088 00000100:00100000:2.0:1787383305.371891:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787383305.371898:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984871936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.371945:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984871936:12345-0@lo:400:kworker.0 Request processed in 47us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.371953:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787383305.371969:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787383305.371976:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984872448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.372004:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984872448:12345-0@lo:400:kworker.0 Request processed in 29us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.372009:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787383305.372019:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787383305.372024:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984872960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383305.372164:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984871808:0@lo:400:kworker.0 00000100:00100000:0.0:1787383305.372243:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984872192:0@lo:400:kworker.0 00000100:00100000:1.0:1787383305.372313:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787383305.372323:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984872576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383305.378507:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383305.378572:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984872320:0@lo:400:kworker.0 00000100:00100000:3.0:1787383305.378617:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383305.378641:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984872832:0@lo:400:kworker.0 00000100:00100000:3.0:1787383305.378667:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383305.378686:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984873344:0@lo:400:kworker.0 00000100:00100000:3.0:1787383305.378712:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383305.378791:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787383305.378805:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984873088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383305.378865:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984873088:12345-0@lo:400:kworker.0 Request processed in 64us (7145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383305.378887:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787383305.378984:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984871808 00000100:00100000:3.0:1787383305.378992:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984871808 00000100:00100000:3.0:1787383305.379028:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787383305.379035:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984871808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.379225:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984872960:12345-0@lo:400:kworker.0 Request processed in 7198us (7640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.379233:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787383305.379268:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984872064 00000100:00100000:2.0:1787383305.379272:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984872064 00000100:00100000:2.0:1787383305.379295:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984872320 00000100:00100000:2.0:1787383305.379298:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984872320 00000100:00100000:2.0:1787383305.379314:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787383305.379328:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984872064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.379367:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984872064:12345-0@lo:400:kworker.0 Request processed in 40us (7725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.379374:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787383305.379389:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787383305.379396:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984872320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.379431:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984872320:12345-0@lo:400:kworker.0 Request processed in 35us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.379438:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1787383305.379460:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383305.379465:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383305.379498:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984872064:0@lo:400:kworker.0 00010000:00080000:2.0:1787383305.379513:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f990e00 x1874206984873088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383305.379524:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984873088:0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.379539:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984871936:0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.379549:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984872448:0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.379558:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984872960:0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.379591:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984872832 00000100:00100000:2.0:1787383305.379594:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984872832 00000100:00100000:2.0:1787383305.379625:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984873344 00000100:00100000:2.0:1787383305.379628:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984873344 00000100:00100000:2.0:1787383305.379643:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787383305.379649:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984872832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.379690:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984872832:12345-0@lo:400:kworker.0 Request processed in 41us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.379696:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787383305.379708:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787383305.379714:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362db0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984873344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383305.379741:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362db0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984873344:12345-0@lo:400:kworker.0 Request processed in 27us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.379747:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1787383305.379929:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383305.379933:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383305.379962:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984872320:0@lo:400:kworker.0 00010000:00080000:2.0:1787383305.379974:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2c000 x1874206984872832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383305.379996:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984872832:0@lo:400:kworker.0 00010000:00080000:2.0:1787383305.380007:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f991500 x1874206984873344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383305.380015:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984873344:0@lo:400:kworker.0 00000100:00100000:3.0:1787383305.380393:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984871808:12345-0@lo:400:kworker.0 Request processed in 1356us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383305.380401:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787383305.380529:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383305.380556:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984872704:0@lo:400:kworker.0 00000100:00100000:0.0:1787383305.380583:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383305.380603:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984873216:0@lo:400:kworker.0 00000100:00100000:0.0:1787383305.380624:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383305.380652:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984872704 00000100:00100000:0.0:1787383305.380656:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984872704 00000100:00100000:0.0:1787383305.380688:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984873216 00000100:00100000:0.0:1787383305.380692:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984873216 00000100:00100000:0.0:1787383305.380708:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787383305.380714:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984872704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383305.380747:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984872704:12345-0@lo:400:kworker.0 Request processed in 33us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383305.380753:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787383305.380787:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787383305.380794:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984873216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383305.380822:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503777800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984873216:12345-0@lo:400:kworker.0 Request processed in 28us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383305.380841:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1787383305.380859:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383305.380862:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787383305.380885:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2e300 x1874206984872704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383305.380897:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984872704:0@lo:400:kworker.0 00010000:00080000:0.0:1787383305.380908:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f991180 x1874206984873216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383305.380917:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984873216:0@lo:400:kworker.0 00000100:00100000:3.0:1787383305.383758:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984872192 00000100:00100000:3.0:1787383305.383795:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984872192 00000100:00100000:3.0:1787383305.383848:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787383305.383857:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984872192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383305.383941:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984872192:12345-0@lo:400:kworker.0 Request processed in 84us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383305.383949:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787383305.384012:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984872192:0@lo:400:kworker.0 00000100:00100000:0.0:1787383305.384233:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.384363:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984871808:0@lo:400:kworker.0 00000100:00100000:3.0:1787383305.384455:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965914112 00000100:00100000:3.0:1787383305.384460:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965914112 00000100:00100000:3.0:1787383305.384502:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:3.0:1787383305.384509:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+11:10510:x1874206965914112:12345-192.168.203.2@tcp:101:touch.500 00010000:00010000:3.0:1787383305.384526:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383305.384546:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532e6af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.384601:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532e6af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026a1 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.384635:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532e6af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026a1 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.384656:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9635036bcc00) 00010000:00010000:3.0:1787383305.384659:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383305.384663:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b6800, rc 0) 00000100:00100000:3.0:1787383305.384996:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+12:10510:x1874206965914112:12345-192.168.203.2@tcp:101:touch.500 Request processed in 486us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383305.385003:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:1.0:1787383305.385281:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984872576:12345-0@lo:400:kworker.0 Request processed in 12957us (13598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383305.385288:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00010000:00080000:2.0:1787383305.385551:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d2d500 x1874206984872576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383305.385563:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984872576:0@lo:400:kworker.0 00000100:00100000:0.0:1787383305.399305:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.399553:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965914240 00000100:00100000:2.0:1787383305.399564:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965914240 00000100:00100000:2.0:1787383305.399622:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:2.0:1787383305.399630:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1874206965914240:12345-192.168.203.2@tcp:8:touch.500 00010000:00080000:2.0:1787383305.399665:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp t0 exp 0000000000000000 cur 338 last 0 00000020:00000080:2.0:1787383305.400627:0:8435:0:(genops.c:1406:class_connect()) connect: client a75c5b6d-4c9e-4295-9df6-097efce92717, cookie 0xc40acec91532e6b6 00002000:00100000:2.0:1787383305.400643:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a75c5b6d-4c9e-4295-9df6-097efce92717/ffff9635034f6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383305.400662:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787383305.400741:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787383305.400793:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9635034f7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383305.400856:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2400:x1874206965914240:12345-192.168.203.2@tcp:8:touch.500 Request processed in 1226us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.400866:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:0.0:1787383305.404234:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.404330:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965914368 00000100:00100000:2.0:1787383305.404340:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965914368 00000100:00100000:2.0:1787383305.404415:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:2.0:1787383305.404425:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:0:x1874206965914368:12345-192.168.203.2@tcp:2:touch.500 00000100:00080000:0.0:1787383305.404541:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787383305.420683:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1787383305.420698:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000100:00100000:2.0:1787383305.420909:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:0:x1874206965914368:12345-192.168.203.2@tcp:2:touch.500 Request processed in 16479us (16678us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787383305.420920:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:0.0:1787383305.425035:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.425204:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965914624 00000100:00100000:2.0:1787383305.425214:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965914624 00000100:00100000:2.0:1787383305.425266:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:2.0:1787383305.425276:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+12:10510:x1874206965914624:12345-192.168.203.2@tcp:35:touch.500 00000100:00100000:2.0:1787383305.425670:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+13:10510:x1874206965914624:12345-192.168.203.2@tcp:35:touch.500 Request processed in 393us (641us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787383305.425679:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:0.0:1787383305.448061:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383305.448149:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965914752 00000100:00100000:3.0:1787383305.448159:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965914752 00000100:00100000:3.0:1787383305.448217:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:3.0:1787383305.448227:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+13:10511:x1874206965914752:12345-192.168.203.2@tcp:101:rm.0 00010000:00010000:3.0:1787383305.448250:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383305.448268:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7600/0xc40acec91532e6bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026a8 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.448326:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7400/0xc40acec91532e6c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.448340:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7400/0xc40acec91532e6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.448352:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7400/0xc40acec91532e6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383305.448392:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787383305.448407:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383305.448457:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7400/0xc40acec91532e6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.448488:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7600/0xc40acec91532e6bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026a8 expref: 15 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.448505:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7400/0xc40acec91532e6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026a8 expref: 14 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.448513:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96350269ac00) 00010000:00010000:3.0:1787383305.448516:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383305.448520:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b7400, rc 0) 00000100:00100000:3.0:1787383305.448575:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+14:10511:x1874206965914752:12345-192.168.203.2@tcp:101:rm.0 Request processed in 350us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383305.448582:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:0.0:1787383305.456489:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.456580:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965915008 00000100:00100000:2.0:1787383305.456591:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965915008 00000100:00100000:2.0:1787383305.456658:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:2.0:1787383305.456670:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+14:10511:x1874206965915008:12345-192.168.203.2@tcp:101:rm.0 00010000:00010000:2.0:1787383305.456690:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383305.456710:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532e6cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026af expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383305.456843:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787383305.456987:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532e6cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026af expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.457001:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350269ad00) 00010000:00010000:2.0:1787383305.457004:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383305.457009:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532e6cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026af expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.457021:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9400, rc 0) 00000100:00100000:2.0:1787383305.457281:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+15:10511:x1874206965915008:12345-192.168.203.2@tcp:101:rm.0 Request processed in 614us (800us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1787383305.457290:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:0.0:1787383305.464878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.464934:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965915136 00000100:00100000:2.0:1787383305.464945:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965915136 00000100:00100000:2.0:1787383305.465004:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:2.0:1787383305.465015:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+15:10511:x1874206965915136:12345-192.168.203.2@tcp:37:rm.0 00000100:00100000:2.0:1787383305.478010:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+15:10511:x1874206965915136:12345-192.168.203.2@tcp:37:rm.0 Request processed in 12987us (13132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.478037:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:3.0:1787383305.483414:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383305.483543:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965915392 00000100:00100000:0.0:1787383305.483553:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965915392 00000100:00100000:0.0:1787383305.483708:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:0.0:1787383305.483720:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628e5b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+15:10511:x1874206965915392:12345-192.168.203.2@tcp:35:rm.0 00000100:00100000:0.0:1787383305.483976:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628e5b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+16:10511:x1874206965915392:12345-192.168.203.2@tcp:35:rm.0 Request processed in 257us (573us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787383305.483983:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:1.0:1787383305.488158:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.488303:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965915648 00000100:00100000:2.0:1787383305.488312:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965915648 00000100:00100000:2.0:1787383305.488380:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:2.0:1787383305.488391:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+16:10511:x1874206965915648:12345-192.168.203.2@tcp:101:rm.0 00010000:00010000:2.0:1787383305.488415:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383305.488435:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532e6d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026b6 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.488803:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e6e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.488818:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e6e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.488829:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e6e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383305.488839:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787383305.488939:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532e6d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026b6 expref: 19 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.488957:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e6e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026b6 expref: 18 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.488966:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96350269ac00) 00010000:00010000:2.0:1787383305.488968:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787383305.488972:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8a00, rc 0) 00000100:00100000:2.0:1787383305.489546:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+18:10511:x1874206965915648:12345-192.168.203.2@tcp:101:rm.0 Request processed in 654us (893us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787383305.489556:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:1.0:1787383305.494863:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.494953:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965915776 00000100:00100000:2.0:1787383305.494963:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965915776 00000100:00100000:2.0:1787383305.495028:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:2.0:1787383305.495038:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+18:10511:x1874206965915776:12345-192.168.203.2@tcp:41:rm.0 00000004:00000024:2.0:1787383305.495109:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1787383305.495180:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+18:10511:x1874206965915776:12345-192.168.203.2@tcp:41:rm.0 Request processed in 142us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.495187:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:3.0:1787383305.501920:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.502058:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965915904 00000100:00100000:2.0:1787383305.502068:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965915904 00000100:00100000:2.0:1787383305.502138:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:2.0:1787383305.502148:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+18:10511:x1874206965915904:12345-192.168.203.2@tcp:101:rm.0 00010000:00010000:2.0:1787383305.502167:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383305.502201:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532e6ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026bd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502267:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e6f5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502281:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e6f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502291:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e6f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502301:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e6fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502321:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e6fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502329:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e6fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502409:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532e703 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502418:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532e703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502425:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532e703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383305.502460:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787383305.502464:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383305.502481:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532e703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502492:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532e703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502500:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e6f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502506:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e6f5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502513:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502529:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383305.502533:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502539:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e6f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502551:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96350269ac00) 00010000:00010000:2.0:1787383305.502554:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383305.502558:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e6f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502563:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532e6f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502575:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e6fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502581:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e6fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502588:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e6fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502593:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383305.502596:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e6fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502601:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e6fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502620:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1ac77968 (ffff96350269a700) 00010000:00010000:2.0:1787383305.502622:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383305.502630:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e6fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502636:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532e6fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502660:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532e6ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026bd expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502673:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532e703 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026bd expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.502680:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9635036bcc00) 00010000:00010000:2.0:1787383305.502682:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383305.502685:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9000, rc 0) 00000100:00100000:2.0:1787383305.502751:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+19:10511:x1874206965915904:12345-192.168.203.2@tcp:101:rm.0 Request processed in 604us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383305.502758:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:1.0:1787383305.512131:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.512237:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965916160 00000100:00100000:2.0:1787383305.512248:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965916160 00000100:00100000:2.0:1787383305.512316:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:2.0:1787383305.512326:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+19:10511:x1874206965916160:12345-192.168.203.2@tcp:36:rm.0 00010000:00010000:2.0:1787383305.512377:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787383305.512405:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532e703 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026bd expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.512445:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532e6af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026a1 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.512456:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9635036bcc00) 00010000:00010000:2.0:1787383305.512466:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7400/0xc40acec91532e6c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026a8 expref: 17 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.512474:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96350269ac00) 00010000:00010000:2.0:1787383305.512483:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383305.512505:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e70a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.512518:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e70a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.512529:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e70a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.512539:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e711 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.512545:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.512551:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.512636:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532e718 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.512655:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532e718 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.512663:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532e718 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383305.513004:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787383305.513015:0:9499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338541248632ns, next at 339541246784ns, rc = 0 00010000:00010000:2.0:1787383305.513075:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec91532e71f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513096:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec91532e71f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513104:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec91532e71f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513111:0:9499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec91532e71f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513118:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec91532e71f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513123:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec91532e71f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513147:0:9499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383305.513166:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532e718 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513171:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532e718 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513185:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532e718 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513189:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383305.513193:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532e718 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513200:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532e718 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513210:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9635036bcc00) 00010000:00010000:2.0:1787383305.513212:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787383305.513215:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532e718 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513221:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532e718 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513237:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e70a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383305.513241:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383305.513244:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e70a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383305.513250:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec91532e71f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513252:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e70a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513268:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383305.513268:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383305.513278:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e70a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383305.513278:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec91532e71f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383305.513295:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec91532e71f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513316:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e70a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383305.513319:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9635036bcc00) 00010000:00010000:2.0:1787383305.513328:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96350269ac00) 00010000:00010000:1.0:1787383305.513332:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787383305.513333:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383305.513341:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e70a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383305.513341:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec91532e71f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513360:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532e70a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383305.513360:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec91532e71f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383305.513383:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017406a13 reply state 000000005f4814c5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e711 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383305.513387:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383305.513390:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383305.513394:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383305.513398:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e711 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383305.513406:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1ac77968 (ffff96350269a700) 00010000:00010000:2.0:1787383305.513408:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787383305.513410:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383305.513489:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+18:10511:x1874206965916160:12345-192.168.203.2@tcp:36:rm.0 Request processed in 1162us (1445us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787383305.513497:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:1.0:1787383305.527454:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383305.527510:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965916416 00000100:00100000:2.0:1787383305.527520:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965916416 00000100:00100000:2.0:1787383305.527584:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:2.0:1787383305.527596:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+18:10511:x1874206965916416:12345-192.168.203.2@tcp:35:rm.0 00000100:00100000:2.0:1787383305.527869:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+19:10511:x1874206965916416:12345-192.168.203.2@tcp:35:rm.0 Request processed in 275us (432us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787383305.527894:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:0.0:1787383305.530608:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383305.530686:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965916672 00000100:00100000:3.0:1787383305.530696:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965916672 00000100:00100000:3.0:1787383305.530756:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:3.0:1787383305.530806:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+19:10511:x1874206965916672:12345-192.168.203.2@tcp:36:rm.0 00010000:00010000:3.0:1787383305.530861:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787383305.530886:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532e6e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026b6 expref: 19 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.530909:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532e67e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402693 expref: 18 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.530935:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff96350269ac00) 00010000:00010000:3.0:1787383305.530952:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7800/0xc40acec91532e63f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402685 expref: 17 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.530961:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350269ad00) 00010000:00010000:3.0:1787383305.530967:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383305.530989:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7600/0xc40acec91532e726 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531001:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7600/0xc40acec91532e726 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531009:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7600/0xc40acec91532e726 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531031:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7200/0xc40acec91532e72d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531039:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7200/0xc40acec91532e72d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531046:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7200/0xc40acec91532e72d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531132:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e734 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531141:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e734 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531159:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e734 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383305.531481:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787383305.531495:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e734 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531503:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e734 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531510:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e734 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531516:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383305.531520:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e734 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531528:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e734 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531537:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff963628ebf400) 00010000:00010000:3.0:1787383305.531539:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787383305.531543:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e734 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531549:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7e00/0xc40acec91532e734 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531567:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7600/0xc40acec91532e726 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531573:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7600/0xc40acec91532e726 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531586:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7600/0xc40acec91532e726 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531591:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383305.531593:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7600/0xc40acec91532e726 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531599:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7600/0xc40acec91532e726 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531607:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebf200) 00010000:00010000:3.0:1787383305.531610:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383305.531613:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7600/0xc40acec91532e726 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531619:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7600/0xc40acec91532e726 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383305.531630:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004cae7ebe reply state 0000000048fe948f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7200/0xc40acec91532e72d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531641:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7200/0xc40acec91532e72d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383305.531648:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff963628ebf900) 00010000:00010000:3.0:1787383305.531650:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787383305.531652:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787383305.531718:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+18:10511:x1874206965916672:12345-192.168.203.2@tcp:36:rm.0 Request processed in 952us (1116us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787383305.531727:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:2.0:1787383305.882943:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984873472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383305.883026:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383305.883204:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984873472 00000100:00100000:0.0:1787383305.883215:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984873472 00000100:00100000:0.0:1787383305.883270:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787383305.883279:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984873472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383305.883308:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383305.883363:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984873472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383305.883370:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:1.0:1787383305.883467:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383305.883522:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984873600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383305.883556:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787383305.883665:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f993100 x1874206984873472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383305.883685:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f993100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984873472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383305.884253:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984873600 00000100:00100000:0.0:1787383305.884260:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984873600 00000100:00100000:0.0:1787383305.884300:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787383305.884308:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984873600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383305.884320:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383305.884368:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984873600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383305.884375:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1787383305.884535:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96363f991f80 x1874206984873600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383305.884552:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984873600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383306.396676:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984873728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383306.396747:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383306.400707:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984873728 00000100:00100000:0.0:1787383306.400722:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984873728 00000100:00100000:0.0:1787383306.400827:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787383306.400837:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984873728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383306.400872:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787383306.400962:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984873728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (4213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383306.400969:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787383306.401242:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984873728:0@lo:41:osp-pre-0-1.0 00000004:00080000:3.0:1787383306.906897:0:8913:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339935128278ns, next at 340935125523ns, rc = 0 00000100:00100000:3.0:1787383306.906922:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383306.906939:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984873856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383306.907015:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383306.907221:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984873984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383306.907254:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383306.907299:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984873856 00000100:00100000:3.0:1787383306.907307:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984873856 00000100:00100000:3.0:1787383306.907342:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984873984 00000100:00100000:3.0:1787383306.907345:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984873984 00000100:00100000:3.0:1787383306.907364:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787383306.907372:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984873856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383306.907394:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383306.907439:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503170700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984873856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383306.907447:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787383306.907468:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787383306.907475:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984873984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787383306.907487:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383306.907518:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984873984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383306.907534:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1787383306.907574:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503170a80 x1874206984873984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383306.907592:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984873984:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787383306.907625:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503173b80 x1874206984873856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383306.907636:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984873856:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787383306.908619:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383307.931649:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383308.347268:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383308.347308:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383308.347339:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383308.347371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383308.347442:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965916800 00000100:00100000:3.0:1787383308.347451:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965916800 00000100:00100000:3.0:1787383308.347505:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 334 00000100:00100000:3.0:1787383308.347515:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965916800:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383308.347576:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965916800:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 63us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383308.347583:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 334 00000100:00100000:2.0:1787383308.347741:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965916928 00000100:00100000:2.0:1787383308.347747:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965916928 00000100:00100000:0.0:1787383308.347762:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965917184 00000100:00100000:0.0:1787383308.347799:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965917184 00000100:00100000:2.0:1787383308.347834:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965917440 00000100:00100000:2.0:1787383308.347839:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965917440 00000100:00100000:0.0:1787383308.347845:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 97 00000100:00100000:0.0:1787383308.347855:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965917184:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383308.347872:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 203 00000100:00100000:2.0:1787383308.347883:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+18:2403:x1874206965916928:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383308.347906:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965917184:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 52us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383308.347914:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 97 00000100:00100000:2.0:1787383308.347929:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+18:2403:x1874206965916928:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 46us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383308.347939:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 203 00000100:00080000:1.0:1787383308.347993:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383308.347998:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383308.348000:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383308.349039:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 204 00000100:00100000:0.0:1787383308.349055:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965917440:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383308.349109:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965917440:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 60us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383308.349116:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 204 00000100:00100000:1.0:1787383308.353137:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383308.353180:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383308.353256:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965917056 00000100:00100000:0.0:1787383308.353265:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965917056 00000100:00100000:0.0:1787383308.353332:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965917312 00000100:00100000:0.0:1787383308.353335:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965917312 00000100:00100000:0.0:1787383308.353361:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 205 00000100:00100000:0.0:1787383308.353370:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965917056:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383308.353453:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965917056:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 83us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383308.353461:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 205 00000100:00100000:0.0:1787383308.353477:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 206 00000100:00100000:0.0:1787383308.353484:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965917312:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383308.353509:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965917312:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383308.353516:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 206 00000100:00080000:1.0:1787383308.353934:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383308.353938:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787383308.955102:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383309.467978:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383309.468001:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984874112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383309.468100:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383309.468312:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984874112 00000100:00100000:1.0:1787383309.468322:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984874112 00000100:00100000:1.0:1787383309.468377:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787383309.468392:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984874112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383309.468425:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383309.468477:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984874112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383309.468483:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787383309.468733:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984874112:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787383309.683631:0:13681:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1787383309.979004:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383310.491395:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984874624:0@lo:400:kworker.0 00000100:00100000:0.0:1787383310.491433:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984874368:0@lo:400:kworker.0 00000100:00100000:2.0:1787383310.491462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383310.491462:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984874496:0@lo:400:kworker.0 00000100:00100000:2.0:1787383310.491524:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984875136:0@lo:400:kworker.0 00000100:00100000:3.0:1787383310.491564:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984874624 00000100:00100000:3.0:1787383310.491573:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984874624 00000100:00100000:3.0:1787383310.491619:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787383310.491628:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984874624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383310.491635:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984874240:0@lo:400:kworker.0 00000100:00100000:1.0:1787383310.491705:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383310.491731:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984874752:0@lo:400:kworker.0 00000100:00100000:3.0:1787383310.491757:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984874624:12345-0@lo:400:kworker.0 Request processed in 130us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383310.491763:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383310.491805:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984875264:0@lo:400:kworker.0 00000100:00100000:3.0:1787383310.491817:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787383310.491825:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383310.491840:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984875776:0@lo:400:kworker.0 00000100:00100000:3.0:1787383310.491843:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984874240 00000100:00100000:3.0:1787383310.491853:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984874240 00000100:00100000:1.0:1787383310.491859:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383310.491890:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787383310.491896:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984874240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383310.491896:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984874752 00000100:00100000:1.0:1787383310.491899:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984874752 00000100:00100000:3.0:1787383310.491930:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984874240:12345-0@lo:400:kworker.0 Request processed in 34us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383310.491930:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787383310.491936:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984874752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383310.491937:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787383310.491962:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984875264 00000100:00100000:3.0:1787383310.491965:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984875264 00000100:00100000:1.0:1787383310.491967:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984874752:12345-0@lo:400:kworker.0 Request processed in 31us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383310.491972:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787383310.491994:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984875776 00000100:00100000:3.0:1787383310.491997:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984875776 00000100:00100000:1.0:1787383310.492005:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787383310.492012:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984875264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383310.492017:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787383310.492022:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984875776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383310.492040:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984875264:12345-0@lo:400:kworker.0 Request processed in 29us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383310.492045:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984875776:12345-0@lo:400:kworker.0 Request processed in 23us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383310.492063:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787383310.492069:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1787383310.492085:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383310.492088:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383310.492110:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984874240:0@lo:400:kworker.0 00000100:00100000:1.0:1787383310.492121:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984874752:0@lo:400:kworker.0 00010000:00080000:1.0:1787383310.492131:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503775500 x1874206984875264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383310.492141:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984875264:0@lo:400:kworker.0 00010000:00080000:1.0:1787383310.492149:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3f100 x1874206984875776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383310.492156:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984875776:0@lo:400:kworker.0 00000100:00100000:2.0:1787383310.492953:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383310.493029:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984875648:0@lo:400:kworker.0 00000100:00100000:1.0:1787383310.493036:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383310.493067:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383310.493098:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984875008:0@lo:400:kworker.0 00000100:00100000:1.0:1787383310.493122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383310.493143:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984875520:0@lo:400:kworker.0 00000100:00100000:1.0:1787383310.493173:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383310.493208:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984875008 00000100:00100000:1.0:1787383310.493213:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984875008 00000100:00100000:1.0:1787383310.493249:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984875520 00000100:00100000:1.0:1787383310.493252:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984875520 00000100:00100000:1.0:1787383310.493274:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787383310.493281:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984875008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383310.493323:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984875008:12345-0@lo:400:kworker.0 Request processed in 43us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383310.493343:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787383310.493358:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787383310.493365:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984875520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383310.493393:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984875520:12345-0@lo:400:kworker.0 Request processed in 29us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383310.493399:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:1.0:1787383310.493418:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787383310.493443:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362da09f80 x1874206984875008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383310.493455:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984875008:0@lo:400:kworker.0 00010000:00080000:1.0:1787383310.493465:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3d180 x1874206984875520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383310.493584:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984875520:0@lo:400:kworker.0 00000100:00100000:0.0:1787383310.493633:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984874496 00000100:00100000:0.0:1787383310.493637:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984874496 00000100:00100000:0.0:1787383310.493705:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787383310.493712:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984874496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383310.493753:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984874496:12345-0@lo:400:kworker.0 Request processed in 41us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383310.493759:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787383310.493969:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984874496:0@lo:400:kworker.0 00000100:00100000:2.0:1787383310.494180:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984874624:0@lo:400:kworker.0 00000100:00100000:2.0:1787383310.494207:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383310.494240:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984874880:0@lo:400:kworker.0 00000100:00100000:2.0:1787383310.494267:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383310.494284:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984875392:0@lo:400:kworker.0 00000100:00100000:2.0:1787383310.494305:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383310.494891:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984875136 00000100:00100000:3.0:1787383310.494899:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984875136 00000100:00100000:0.0:1787383310.496034:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984874368 00000100:00100000:0.0:1787383310.496043:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984874368 00000100:00100000:0.0:1787383310.496087:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984874880 00000100:00100000:0.0:1787383310.496091:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984874880 00000100:00100000:0.0:1787383310.496108:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984875392 00000100:00100000:0.0:1787383310.496111:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984875392 00000100:00100000:0.0:1787383310.496132:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787383310.496143:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984874368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383310.496406:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984875648 00000100:00100000:3.0:1787383310.496410:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984875648 00000100:00100000:3.0:1787383310.496436:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787383310.496442:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984875136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383310.496487:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984875136:12345-0@lo:400:kworker.0 Request processed in 44us (3535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383310.496494:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787383310.496511:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787383310.496518:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984875648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383310.496708:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787383310.496717:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984874880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383310.496849:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984875648:12345-0@lo:400:kworker.0 Request processed in 330us (3780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383310.496864:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1787383310.496905:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503776300 x1874206984875136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383310.496918:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984875136:0@lo:400:kworker.0 00010000:00080000:3.0:1787383310.496931:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3dc00 x1874206984875648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383310.496940:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984875648:0@lo:400:kworker.0 00000100:00100000:3.0:1787383310.496979:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787383310.496999:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984875392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383310.497135:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984874368:0@lo:400:kworker.0 00000100:00100000:1.0:1787383310.497180:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984874880:12345-0@lo:400:kworker.0 Request processed in 463us (2911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383310.497187:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787383310.497217:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984874880:0@lo:400:kworker.0 00000100:00080000:1.0:1787383310.497236:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383310.497240:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383310.497243:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383310.497322:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984875392:12345-0@lo:400:kworker.0 Request processed in 335us (3015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383310.497388:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787383310.497446:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363f997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984875392:0@lo:400:kworker.0 00000100:00100000:0.0:1787383310.498197:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984874368:12345-0@lo:400:kworker.0 Request processed in 2052us (3987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383310.498207:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000020:00000080:0.0:1787383310.696254:0:13729:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc822e0900 00000020:00000080:0.0:1787383310.696270:0:13729:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787383310.696275:0:13729:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787383310.696284:0:13729:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc822e2b90 20000000:00000080:0.0:1787383310.696297:0:13729:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff963503d92000 uarg=0000000000000000 20000000:01000000:0.0:1787383310.696346:0:13729:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787383310.696353:0:13729:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787383310.696359:0:13729:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787383310.697054:0:13730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787383310.697200:0:13729:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787383310.707478:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787383310.707531:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787383310.707550:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787383310.707568:0:13729:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787383310.707588:0:13729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.707607:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c8e00/0xc40acec91532e5cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e5c8 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.707615:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96363dac8200/0xc40acec91532e5dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e5d6 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.707622:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636352c0e00/0xc40acec91532e5eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e5e4 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.707628:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636352c0200/0xc40acec91532e5f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e5f2 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.707638:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636352c1400/0xc40acec91532e600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402670 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.707645:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636352c1e00/0xc40acec91532e607 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402677 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.707653:0:13729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.707690:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636352c1e00/0xc40acec91532e607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402677 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.707720:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636352c1e00/0xc40acec91532e607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402677 expref: 12 pid: 6514 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383310.707735:0:13729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1874206984875904:192.168.203.2@tcp:104: 00000004:00080000:0.0:1787383310.709995:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787383310.710032:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1787383310.710043:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1787383310.710081:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532e693 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710093:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532e693 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710100:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532e693 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710105:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383310.710109:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532e693 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710116:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532e693 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710132:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1ac77968 (ffff96350269a700) 00010000:00010000:0.0:1787383310.710135:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383310.710139:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532e693 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710145:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532e693 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710177:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532e6a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710184:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532e6a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710189:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532e6a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710194:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383310.710196:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532e6a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710213:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532e6a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710340:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9635036bcc00) 00010000:00010000:0.0:1787383310.710343:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383310.710346:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532e6a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710351:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532e6a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710372:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e711 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710377:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e711 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710382:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e711 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710395:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383310.710398:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e711 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710403:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e711 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710411:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1ac77968 (ffff96350269a700) 00010000:00010000:0.0:1787383310.710413:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383310.710416:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e711 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710421:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532e711 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1ac77968 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710435:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7200/0xc40acec91532e72d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710441:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7200/0xc40acec91532e72d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710446:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7200/0xc40acec91532e72d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710450:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383310.710452:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7200/0xc40acec91532e72d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710458:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7200/0xc40acec91532e72d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710476:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff963628ebf900) 00010000:00010000:0.0:1787383310.710478:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383310.710481:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7200/0xc40acec91532e72d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383310.710487:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b7200/0xc40acec91532e72d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383310.710808:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383310.710824:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984876032:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787383310.710885:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383310.710974:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636352c1400/0xc40acec91532e600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402670 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.710997:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636352c1400/0xc40acec91532e600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402670 expref: 12 pid: 6514 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383310.711008:0:13729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1874206984876160:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383310.711171:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636352c0200/0xc40acec91532e5f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e5f2 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.711180:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636352c0200/0xc40acec91532e5f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e5f2 expref: 23 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383310.711188:0:13729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1874206984876288:0@lo:104: 00000100:00100000:1.0:1787383310.711232:0:13729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383310.711258:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636352c0e00/0xc40acec91532e5eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e5e4 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.711265:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636352c0e00/0xc40acec91532e5eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e5e4 expref: 23 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383310.711274:0:13729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1874206984876416:0@lo:104: 00010000:00010000:1.0:1787383310.711299:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96363dac8200/0xc40acec91532e5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e5d6 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.711320:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96363dac8200/0xc40acec91532e5dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e5d6 expref: 23 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383310.711330:0:13729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1874206984876544:0@lo:104: 00010000:00010000:1.0:1787383310.711357:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c8e00/0xc40acec91532e5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532e5c8 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.711364:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9636113c8e00/0xc40acec91532e5cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532e5c8 expref: 23 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383310.711371:0:13729:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1874206984876672:0@lo:104: 00000100:00100000:1.0:1787383310.711387:0:13729:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636065136c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383310.712683:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984876032 00000100:00100000:3.0:1787383310.712695:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984876032 00000100:00100000:3.0:1787383310.712761:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383310.712786:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984876032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787383310.712814:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1787383310.712847:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a894e09, atime: 0x6a894e09, ctime: 0x6a894e09, blocks: 0x0 00010000:00010000:3.0:1787383310.712854:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3c2cab9/0xc40acec91532e742 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383310.712879:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:3.0:1787383310.712884:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383310.712890:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3c2cab9/0xc40acec91532e742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383310.712905:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3c2cab9/0xc40acec91532e742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383310.712917:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3c2cab9/0xc40acec91532e742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383310.712924:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3c2cab9/0xc40acec91532e742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383310.712951:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383310.713089:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383310.713097:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3c2cab9/0xc40acec91532e742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.713105:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383310.713110:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3c2cab9/0xc40acec91532e742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.713118:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3c2cab9/0xc40acec91532e742 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.713136:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3c2cab9/0xc40acec91532e742 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.713142:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3c2cab9/0xc40acec91532e742 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.713168:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383310.713170:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383310.713173:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383310.713534:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1874206984876032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 748us (2647us total) trans 4294967301 rc 0/0 00000004:00080000:1.0:1787383310.713619:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff963503173b80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787383310.713628:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984876032:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787383310.713664:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787383310.713668:0:10396:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787383310.713694:0:10396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383310.713725:0:10396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383310.713759:0:10396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383310.713790:0:10396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984876288 00000100:00100000:2.0:1787383310.713795:0:10396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984876288 00000100:00100000:2.0:1787383310.713819:0:10396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984876416 00000100:00100000:2.0:1787383310.713822:0:10396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984876416 00000100:00100000:2.0:1787383310.713831:0:10396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984876544 00000100:00100000:2.0:1787383310.713835:0:10396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984876544 00000100:00100000:2.0:1787383310.713845:0:10396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984876672 00000100:00100000:2.0:1787383310.713847:0:10396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984876672 00000100:00100000:2.0:1787383310.713859:0:10396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787383310.713866:0:10396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502636450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+6:13729:x1874206984876288:12345-0@lo:104: 00010000:00010000:2.0:1787383310.713879:0:10396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e5f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.713927:0:10396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787383310.713933:0:10396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502636450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+6:13729:x1874206984876288:12345-0@lo:104: Request processed in 67us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383310.713939:0:10396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787383310.713976:0:10396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787383310.713982:0:10396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+5:13729:x1874206984876416:12345-0@lo:104: 00010000:00010000:2.0:1787383310.714000:0:10396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e5eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714034:0:10396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787383310.714040:0:10396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+5:13729:x1874206984876416:12345-0@lo:104: Request processed in 59us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383310.714056:0:10396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787383310.714069:0:10396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787383310.714075:0:10396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+4:13729:x1874206984876544:12345-0@lo:104: 00010000:00010000:2.0:1787383310.714083:0:10396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e5dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714114:0:10396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787383310.714118:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787383310.714123:0:10396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:68140aec-1198-480f-b348-a4187c7bb1d1+4:13729:x1874206984876544:12345-0@lo:104: Request processed in 47us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383310.714134:0:10396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787383310.714134:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+4:13729:x1874206984876672:12345-0@lo:104: 00010000:00010000:1.0:1787383310.714146:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e5cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714154:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787383310.714161:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e5f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714169:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655400 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383310.714174:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e5f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714182:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e5f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383310.714190:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e5f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.714196:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:01000000:2.0:1787383310.714207:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787383310.714224:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:68140aec-1198-480f-b348-a4187c7bb1d1+3:13729:x1874206984876672:12345-0@lo:104: Request processed in 87us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383310.714232:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787383310.714269:0:13729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1874206984876288:0@lo:104: 00000100:00100000:1.0:1787383310.714278:0:13729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1874206984876416:0@lo:104: 00000100:00100000:1.0:1787383310.714284:0:13729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1874206984876544:0@lo:104: 00000100:00100000:1.0:1787383310.714290:0:13729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1874206984876672:0@lo:104: 00010000:00010000:2.0:1787383310.714422:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e5f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714430:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383310.714459:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e5f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383310.714464:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1787383310.714467:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601655400/0xc40acec91532e5f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e5f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714480:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:3.0:1787383310.714481:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984876800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383310.714487:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e5eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714495:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383310.714498:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e5eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714505:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e5eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383310.714511:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e5eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383310.714517:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787383310.714523:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383310.714534:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e5eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714542:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383310.714558:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e5eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383310.714564:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984876800 00010000:00010000:2.0:1787383310.714565:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601654e00/0xc40acec91532e5e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e5eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383310.714570:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984876800 00010000:00010000:2.0:1787383310.714580:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383310.714585:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e5dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714592:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655600 already unused, calling callback (ffffffffc129ec20) 00010000:00010000:3.0:1787383310.714593:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636352c0200/0xc40acec91532e5f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e5f2 expref: 24 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383310.714596:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e5dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714613:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e5dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383310.714620:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e5dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383310.714626:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787383310.714628:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1787383310.714641:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e5dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383310.714647:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984876800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383310.714652:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383310.714662:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383310.714670:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636352c0200/0xc40acec91532e5f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e5f2 expref: 24 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714671:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e5dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714689:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601655600/0xc40acec91532e5d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e5dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383310.714692:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636352c0200/0xc40acec91532e5f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e5f2 expref: 24 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714709:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383310.714715:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c0200/0xc40acec91532e5f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e5f2 expref: 24 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714720:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532e5cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714728:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0800 already unused, calling callback (ffffffffc129ec20) 00010000:00010000:3.0:1787383310.714730:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:2.0:1787383310.714744:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532e5cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714752:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532e5cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383310.714760:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+23:3648:x1874206984876800:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (236us total) trans 0 rc 0/0 10000000:00010000:2.0:1787383310.714762:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532e5cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383310.714787:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787383310.714798:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1787383310.714809:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e5cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714816:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787383310.714825:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984876928:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383310.714825:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e5cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714836:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c0800/0xc40acec91532e5c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532e5cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.714851:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383310.714855:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383310.714856:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383310.714860:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383310.714883:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984877184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383310.714887:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984876800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383310.714916:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383310.714919:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984876928 00000100:00100000:3.0:1787383310.714924:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984876928 00000100:00100000:2.0:1787383310.714941:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1787383310.714942:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636352c0e00/0xc40acec91532e5eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e5e4 expref: 23 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383310.714951:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984877056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383310.714965:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984877184 00000100:00100000:3.0:1787383310.714970:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984877184 00000100:00100000:2.0:1787383310.714987:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787383310.715000:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c8e00/0xc40acec91532e5cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e5c8 expref: 24 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383310.715014:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984877056 00000100:00100000:3.0:1787383310.715019:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787383310.715020:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984877056 00010000:00010000:2.0:1787383310.715038:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96363dac8200/0xc40acec91532e5dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e5d6 expref: 25 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383310.715040:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503171c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+25:3648:x1874206984876928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383310.715065:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383310.715072:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636352c0e00/0xc40acec91532e5eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e5e4 expref: 25 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383310.715074:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787383310.715085:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+25:3650:x1874206984877184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383310.715088:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636352c0e00/0xc40acec91532e5eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e5e4 expref: 25 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.715096:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383310.715102:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c0e00/0xc40acec91532e5eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e5e4 expref: 25 pid: 6514 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.715104:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c8e00/0xc40acec91532e5cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e5c8 expref: 25 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383310.715120:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383310.715124:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c8e00/0xc40acec91532e5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e5c8 expref: 24 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.715138:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c8e00/0xc40acec91532e5cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e5c8 expref: 24 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383310.715149:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383310.715156:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503171c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+23:3648:x1874206984876928:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383310.715163:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787383310.715182:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787383310.715186:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+22:3650:x1874206984877184:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383310.715195:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+22:3650:x1874206984877056:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383310.715199:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787383310.715229:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984877184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383310.715380:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383310.715388:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96363dac8200/0xc40acec91532e5dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532e5d6 expref: 21 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383310.715396:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96363dac8200/0xc40acec91532e5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532e5d6 expref: 21 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383310.715406:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac8200/0xc40acec91532e5dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532e5d6 expref: 21 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383310.715414:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383310.715439:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68140aec-1198-480f-b348-a4187c7bb1d1+20:3650:x1874206984877056:12345-0@lo:103:ldlm_bl.0 Request processed in 248us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383310.715452:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787383310.715488:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984876928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383310.715593:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984877056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383310.715614:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383310.716443:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383310.717641:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383310.717826:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965917568 00000100:00100000:1.0:1787383310.717834:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965917568 00010000:00010000:1.0:1787383310.717867:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636352c1e00/0xc40acec91532e607 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402677 expref: 13 pid: 6514 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383310.717981:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965917696 00000100:00100000:1.0:1787383310.718004:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965917696 00010000:00010000:1.0:1787383310.718018:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636352c1400/0xc40acec91532e600 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402670 expref: 14 pid: 6514 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383310.718039:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:1.0:1787383310.718056:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6bbc500f-638e-4719-909d-90fd49cd1aa8+14:2402:x1874206965917568:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383310.718095:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787383310.718116:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:3.0:1787383310.718124:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bbc500f-638e-4719-909d-90fd49cd1aa8+14:2402:x1874206965917696:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383310.718132:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383310.718138:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636352c1400/0xc40acec91532e600 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402670 expref: 14 pid: 6514 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383310.718148:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636352c1400/0xc40acec91532e600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402670 expref: 14 pid: 6514 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383310.718167:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383310.718200:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636352c1e00/0xc40acec91532e607 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402677 expref: 14 pid: 6514 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.718225:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636352c1e00/0xc40acec91532e607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402677 expref: 14 pid: 6514 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.718238:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.718250:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.718265:0:8450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.718272:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.718279:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.718286:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.718292:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383310.718303:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.718312:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.718321:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.718331:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383310.718457:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6bbc500f-638e-4719-909d-90fd49cd1aa8+14:2402:x1874206965917696:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 331us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383310.718466:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:1.0:1787383310.718747:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2402:x1874206965917568:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 699us (2305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383310.718754:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 50 00010000:00010000:1.0:1787383310.720869:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c1e00/0xc40acec91532e607 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402677 expref: 12 pid: 6514 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383310.720890:0:13729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1874206984875904:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383310.720903:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c1400/0xc40acec91532e600 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402670 expref: 11 pid: 6514 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383310.720910:0:13729:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1874206984876160:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383310.720940:0:13729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.720949:0:13729:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.720955:0:13729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383310.720977:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c1000/0xc40acec91532e73b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383311.003543:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787383311.003566:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984877312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383311.003632:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383311.003801:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383311.003879:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984877312 00000100:00100000:3.0:1787383311.003887:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984877312 00000100:00100000:1.0:1787383311.003943:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383311.003944:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787383311.003956:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984877440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383311.003958:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984877312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383311.004003:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383311.004003:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383311.004063:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984877312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383311.004071:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787383311.004086:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984877440 00000100:00100000:3.0:1787383311.004089:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984877440 00000100:00100000:3.0:1787383311.004119:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787383311.004125:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984877440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383311.004135:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383311.004174:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984877440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383311.004180:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1787383311.004366:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350206aa00 x1874206984877440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383311.004382:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984877440:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787383311.004900:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503171500 x1874206984877312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383311.004930:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984877312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383311.523051:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383311.523075:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984877568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383311.523137:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383311.523350:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984877568 00000100:00100000:1.0:1787383311.523366:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984877568 00000100:00100000:1.0:1787383311.523410:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787383311.523419:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984877568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383311.523449:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787383311.523883:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984877568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 465us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383311.523892:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787383311.524170:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984877568:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1787383311.536913:0:13778:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffebc1c27b0 00000020:00000080:1.0:1787383311.536927:0:13778:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787383311.536931:0:13778:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787383311.536939:0:13778:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebc1c4a40 20000000:00000080:1.0:1787383311.536944:0:13778:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff963503cd7000 uarg=0000000000000000 20000000:01000000:1.0:1787383311.537194:0:13778:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1787383311.537201:0:13778:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1787383311.537206:0:13778:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1787383311.537944:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1787383311.538245:0:13778:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1787383311.538336:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1787383311.538630:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1787383311.538655:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1787383311.538668:0:13778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787383311.538689:0:13778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9636421f6e00/0xc40acec91532e749 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383311.538704:0:13778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636421f6e00/0xc40acec91532e749 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383311.538713:0:13778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636421f6e00/0xc40acec91532e749 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383311.538720:0:13778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636421f6e00/0xc40acec91532e749 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383311.538727:0:13778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9636421f6e00/0xc40acec91532e749 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383311.538733:0:13778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9636421f6e00/0xc40acec91532e749 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383311.538740:0:13778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383311.538745:0:13778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9636421f6e00/0xc40acec91532e749 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383311.538752:0:13778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9636421f6e00/0xc40acec91532e749 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383311.538854:0:13778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9636421f6e00/0xc40acec91532e749 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383311.538861:0:13778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9636421f6e00/0xc40acec91532e749 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383311.539464:0:13778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636421f6e00/0xc40acec91532e749 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383311.925975:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383311.926053:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965917824 00000100:00100000:1.0:1787383311.926062:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965917824 00000100:00100000:1.0:1787383311.926119:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 336 00000100:00100000:1.0:1787383311.926129:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:6173:x1874206965917824:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383311.926145:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383311.926165:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c1c00/0xc40acec91532e750 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026c4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383311.926194:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c1c00/0xc40acec91532e750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026c4 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383311.926205:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c1c00/0xc40acec91532e750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026c4 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383311.926215:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1c00, rc 0) 00000100:00100000:1.0:1787383311.926314:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:6173:x1874206965917824:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 187us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383311.926322:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 336 00000100:00100000:3.0:1787383311.934309:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383311.934418:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965917952 00000100:00100000:0.0:1787383311.934427:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965917952 00000100:00100000:0.0:1787383311.934494:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 337 00000100:00100000:0.0:1787383311.934504:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:6173:x1874206965917952:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383311.934650:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:6173:x1874206965917952:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 147us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383311.934657:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 337 00000100:00100000:0.0:1787383311.938023:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383311.939012:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965918080 00000100:00100000:3.0:1787383311.939025:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965918080 00000100:00100000:3.0:1787383311.939093:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 338 00000100:00100000:3.0:1787383311.939104:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:6173:x1874206965918080:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383311.939300:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:6173:x1874206965918080:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 197us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383311.939308:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 338 00000100:00100000:2.0:1787383311.945028:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383311.945302:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965918208 00000100:00100000:1.0:1787383311.945311:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965918208 00000100:00100000:1.0:1787383311.945363:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 339 00000100:00100000:1.0:1787383311.945667:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:10795:x1874206965918208:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383311.945850:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:10795:x1874206965918208:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 186us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383311.946494:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 339 00000100:00100000:1.0:1787383311.951231:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383311.951636:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965918336 00000100:00100000:0.0:1787383311.951646:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965918336 00000100:00100000:0.0:1787383311.951701:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 340 00000100:00100000:0.0:1787383311.951710:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:10795:x1874206965918336:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383311.951951:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:10795:x1874206965918336:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 241us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383311.951968:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 340 00000100:00100000:0.0:1787383311.962393:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383311.962803:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965918464 00000100:00100000:1.0:1787383311.962824:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965918464 00000100:00100000:1.0:1787383311.962874:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 341 00000100:00100000:1.0:1787383311.962884:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:6173:x1874206965918464:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383311.962901:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383311.962918:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c1a00/0xc40acec91532e757 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383311.962944:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c1a00/0xc40acec91532e757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026cb expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383311.962955:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c1a00/0xc40acec91532e757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026cb expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383311.962964:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1a00, rc 0) 00000100:00100000:1.0:1787383311.963161:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:6173:x1874206965918464:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 277us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383311.963169:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 341 00000100:00100000:2.0:1787383311.971392:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383311.973158:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965918592 00000100:00100000:0.0:1787383311.973172:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965918592 00000100:00100000:0.0:1787383311.973238:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 342 00000100:00100000:0.0:1787383311.973247:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:6173:x1874206965918592:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383311.973406:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:6173:x1874206965918592:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 160us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383311.973416:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 342 00000100:00100000:3.0:1787383311.977172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383311.979032:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965918720 00000100:00100000:1.0:1787383311.979055:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965918720 00000100:00100000:1.0:1787383311.979118:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 343 00000100:00100000:1.0:1787383311.979129:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:6173:x1874206965918720:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383311.979279:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:6173:x1874206965918720:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 151us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383311.979287:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 343 00000100:00100000:1.0:1787383311.986300:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383311.990213:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965918848 00000100:00100000:3.0:1787383311.990227:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965918848 00000100:00100000:3.0:1787383311.990293:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 344 00000100:00100000:3.0:1787383311.990304:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:10798:x1874206965918848:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787383311.991076:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:10798:x1874206965918848:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 769us (4782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383311.991085:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 344 00000100:00100000:2.0:1787383311.996825:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383311.997000:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965918976 00000100:00100000:0.0:1787383311.997010:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965918976 00000100:00100000:0.0:1787383311.997079:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 345 00000100:00100000:0.0:1787383311.997090:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:10798:x1874206965918976:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383311.997250:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:10798:x1874206965918976:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 161us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383311.997258:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 345 00010000:00010000:2.0:1787383312.027104:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383312.027436:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984877696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383312.027534:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383312.028113:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984877696 00000100:00100000:3.0:1787383312.028129:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984877696 00000100:00100000:2.0:1787383312.028158:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383312.028190:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787383312.028200:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874206984877696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383312.028230:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787383312.028237:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383312.028283:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874206984877696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383312.028291:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787383312.028406:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984877696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383312.032346:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984877824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383312.032431:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383312.032616:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984877824 00000100:00100000:1.0:1787383312.032625:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984877824 00000100:00100000:1.0:1787383312.032692:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787383312.032701:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984877824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383312.032726:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383312.032797:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984877824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383312.032804:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787383312.034047:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383312.034103:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984877824:0@lo:13:osp-pre-0-1.0 10000000:01000000:2.0:1787383312.606594:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787383312.606611:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96350233b000 from 7 10000000:01000000:2.0:1787383312.606616:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787383312.606665:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383312.606678:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383312.606690:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383312.606733:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984877952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383312.606819:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383312.606893:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383312.607142:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984877952 00000100:00100000:3.0:1787383312.607151:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984877952 00000100:00100000:0.0:1787383312.607535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1787383312.607548:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+20:6517:x1874206984877952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383312.607563:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383312.607579:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96363dac8000/0xc40acec91532e765 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e75e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383312.607614:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac8000/0xc40acec91532e765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e75e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383312.607639:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96363dac8000/0xc40acec91532e765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e75e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383312.607647:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac8000, rc 0) 00000100:00100000:0.0:1787383312.607700:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984877952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383312.607708:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787383312.607852:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984877952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383312.607867:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383312.607875:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383312.607948:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984878080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383312.607979:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383312.608009:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383312.608071:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984878080 00000100:00100000:1.0:1787383312.608076:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984878080 00000100:00100000:1.0:1787383312.608110:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1787383312.608118:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984878080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383312.608228:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984878080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383312.608234:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787383312.608465:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984878080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383312.608494:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984878208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383312.608533:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383312.608554:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383312.608716:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984878208 00000100:00100000:0.0:1787383312.608721:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984878208 00000100:00100000:0.0:1787383312.608753:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1787383312.608760:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984878208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383312.608877:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984878208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383312.608884:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787383312.610702:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984878208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383312.611671:0:13791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13791:1874206984878336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383312.611747:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383312.611809:0:13791:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503655b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383312.611874:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984878336 00000100:00100000:1.0:1787383312.611882:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984878336 00000100:00100000:1.0:1787383312.611937:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787383312.611945:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:13791:x1874206984878336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383312.612076:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+21:13791:x1874206984878336:12345-0@lo:502:llog_process_th.0 Request processed in 131us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383312.612084:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787383312.612335:0:13791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13791:1874206984878336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383312.612361:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383312.612370:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383312.612372:0:13791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787383312.612378:0:13791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96350233b000 00000020:00000080:3.0:1787383312.612381:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787383312.612447:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383312.612451:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383312.612452:0:13791:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787383312.612455:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383312.612457:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383312.612459:0:13791:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787383312.612462:0:13791:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96350233b000 00000020:00000080:3.0:1787383312.612464:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787383312.612497:0:13791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13791:1874206984878464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383312.612534:0:13791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383312.612558:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984878464 00000100:00100000:3.0:1787383312.612563:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984878464 00000100:00100000:3.0:1787383312.612587:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787383312.612593:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:13791:x1874206984878464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383312.612675:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:13791:x1874206984878464:12345-0@lo:502:llog_process_th.0 Request processed in 82us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383312.612682:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787383312.612709:0:13791:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d113c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383312.612721:0:13791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13791:1874206984878464:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383312.612737:0:13791:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383312.612741:0:13791:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383312.612742:0:13791:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787383312.612745:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787383312.612828:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787383312.612857:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383312.612867:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.612878:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383312.612889:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383312.612891:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96363d95c800 from 7 10000000:01000000:3.0:1787383312.612894:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383312.612931:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.612940:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.612949:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383312.612963:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984878592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.612996:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383312.613016:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d113c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383312.613028:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984878592 00000100:00100000:3.0:1787383312.613043:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984878592 00000100:00100000:3.0:1787383312.613061:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787383312.613066:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+21:6517:x1874206984878592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383312.613074:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383312.613084:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b7600/0xc40acec91532e773 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e76c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.613104:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b7600/0xc40acec91532e773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e76c expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.613114:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b7600/0xc40acec91532e773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e76c expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.613121:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b7600, rc 0) 00000100:00100000:3.0:1787383312.613150:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984878592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383312.613155:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787383312.613180:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984878592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383312.613192:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.613200:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383312.613240:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984878720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.613268:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383312.613280:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d113c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383312.613290:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984878720 00000100:00100000:3.0:1787383312.613293:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984878720 00000100:00100000:3.0:1787383312.613309:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787383312.613314:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984878720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.613398:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984878720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383312.613405:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787383312.613430:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984878720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.613453:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984878848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.613485:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383312.613498:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d113c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383312.613508:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984878848 00000100:00100000:3.0:1787383312.613511:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984878848 00000100:00100000:3.0:1787383312.613527:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787383312.613532:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96361a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984878848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.613592:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96361a7c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984878848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383312.613598:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787383312.613631:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984878848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.613903:0:13792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13792:1874206984878976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383312.613935:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383312.613952:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984878976 00000100:00100000:3.0:1787383312.613962:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984878976 00000100:00100000:3.0:1787383312.613979:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787383312.613984:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:13792:x1874206984878976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383312.614059:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:13792:x1874206984878976:12345-0@lo:502:llog_process_th.0 Request processed in 74us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383312.614065:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787383312.614095:0:13792:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383312.614106:0:13792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13792:1874206984878976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383312.614124:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383312.614131:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383312.614133:0:13792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787383312.614139:0:13792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96363d95c800 00000020:00000080:3.0:1787383312.614141:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787383312.614174:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383312.614177:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383312.614178:0:13792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787383312.614181:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383312.614183:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383312.614184:0:13792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787383312.614187:0:13792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96363d95c800 00000020:00000080:3.0:1787383312.614189:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787383312.614216:0:13792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13792:1874206984879104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383312.614246:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383312.614263:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984879104 00000100:00100000:3.0:1787383312.614266:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984879104 00000100:00100000:3.0:1787383312.614281:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787383312.614287:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:13792:x1874206984879104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383312.614338:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:13792:x1874206984879104:12345-0@lo:502:llog_process_th.0 Request processed in 50us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383312.614350:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1787383312.614374:0:13792:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383312.614384:0:13792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13792:1874206984879104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383312.614398:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383312.614402:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383312.614403:0:13792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787383312.614405:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787383312.614440:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787383312.614453:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383312.614460:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.614468:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383312.614477:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383312.614479:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9636183cf000 from 7 10000000:01000000:3.0:1787383312.614482:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383312.614500:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.614507:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.614514:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383312.614526:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984879232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.614552:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383312.614573:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383312.614585:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984879232 00000100:00100000:3.0:1787383312.614588:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984879232 00000100:00100000:3.0:1787383312.614604:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787383312.614609:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+22:6517:x1874206984879232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383312.614616:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383312.614626:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636102b7e00/0xc40acec91532e781 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e77a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.614642:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636102b7e00/0xc40acec91532e781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e77a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.614651:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636102b7e00/0xc40acec91532e781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e77a expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.614659:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b7e00, rc 0) 00000100:00100000:3.0:1787383312.614684:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984879232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383312.614690:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787383312.614717:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984879232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383312.614728:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.614736:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383312.614810:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984879360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.614833:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383312.614858:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383312.614876:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984879360 00000100:00100000:3.0:1787383312.614879:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984879360 00000100:00100000:3.0:1787383312.614894:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787383312.614899:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984879360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.614969:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984879360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383312.614975:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787383312.615001:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984879360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.615024:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984879488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.615067:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383312.615079:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383312.615088:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984879488 00000100:00100000:3.0:1787383312.615091:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984879488 00000100:00100000:3.0:1787383312.615107:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787383312.615113:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984879488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.615170:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984879488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383312.615176:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787383312.615208:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984879488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.615378:0:13793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13793:1874206984879616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383312.615410:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383312.615428:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984879616 00000100:00100000:3.0:1787383312.615432:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984879616 00000100:00100000:3.0:1787383312.615448:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787383312.615453:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963610eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:13793:x1874206984879616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383312.615515:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963610eb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:13793:x1874206984879616:12345-0@lo:502:llog_process_th.0 Request processed in 61us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383312.615522:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1787383312.615546:0:13793:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383312.615557:0:13793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13793:1874206984879616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383312.615575:0:13793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383312.615582:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383312.615584:0:13793:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787383312.615589:0:13793:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9636183cf000 00000020:00000080:3.0:1787383312.615592:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787383312.615625:0:13793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383312.615628:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383312.615629:0:13793:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787383312.615631:0:13793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383312.615634:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383312.615635:0:13793:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787383312.615638:0:13793:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9636183cf000 00000020:00000080:3.0:1787383312.615639:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787383312.615665:0:13793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13793:1874206984879744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383312.615696:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383312.615714:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984879744 00000100:00100000:3.0:1787383312.615717:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984879744 00000100:00100000:3.0:1787383312.615734:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787383312.615739:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:13793:x1874206984879744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383312.615825:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:13793:x1874206984879744:12345-0@lo:502:llog_process_th.0 Request processed in 84us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383312.615831:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787383312.615868:0:13793:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383312.615880:0:13793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13793:1874206984879744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383312.615897:0:13793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383312.615902:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383312.615903:0:13793:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787383312.615907:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787383312.615944:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787383312.615961:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383312.615968:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.615978:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383312.615987:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383312.615989:0:6517:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9636064d1800 from 7 10000000:01000000:3.0:1787383312.615992:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383312.616010:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.616017:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383312.616025:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383312.629720:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984879872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383312.629868:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383312.634131:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11180 going to sleep for 11 seconds 00000100:00100000:2.0:1787383312.641563:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984879872 00000100:00100000:2.0:1787383312.641579:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984879872 00000100:00100000:2.0:1787383312.641680:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787383312.641690:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+23:6517:x1874206984879872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383312.641706:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383312.641724:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636421f7c00/0xc40acec91532e78f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532e788 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383312.641761:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636421f7c00/0xc40acec91532e78f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532e788 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383312.641788:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636421f7c00/0xc40acec91532e78f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532e788 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383312.641798:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7c00, rc 0) 00000100:00100000:2.0:1787383312.641870:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984879872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (12001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383312.641876:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787383312.641917:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984879872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383312.641934:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383312.641944:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383312.642012:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984880000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383312.642057:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383312.642082:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383312.642099:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984880000 00000100:00100000:2.0:1787383312.642102:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984880000 00000100:00100000:2.0:1787383312.642117:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1787383312.642122:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984880000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383312.642219:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984880000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383312.642235:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1787383312.642259:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984880000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383312.642283:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984880128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383312.642321:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383312.642329:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608d8a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383312.642342:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984880128 00000100:00100000:2.0:1787383312.642346:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984880128 00000100:00100000:2.0:1787383312.642362:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787383312.642367:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984880128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383312.644142:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:6517:x1874206984880128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1766us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383312.644155:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787383312.644209:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:68140aec-1198-480f-b348-a4187c7bb1d1:6517:1874206984880128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383312.654340:0:13796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13796:1874206984880256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383312.654833:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383312.654886:0:13796:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503e7b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383312.654967:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984880256 00000100:00100000:2.0:1787383312.654974:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984880256 00000100:00100000:2.0:1787383312.655017:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787383312.655024:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:13796:x1874206984880256:12345-0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787383312.658259:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787383312.661617:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:13796:x1874206984880256:12345-0@lo:502:llog_process_th.0 Request processed in 6573us (6765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383312.661634:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787383312.661922:0:13796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13796:1874206984880256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383312.661958:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383312.661969:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383312.661971:0:13796:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787383312.661981:0:13796:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9636064d1800 00000020:00000080:1.0:1787383312.661984:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787383312.662053:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383312.662058:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383312.662060:0:13796:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787383312.662062:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383312.662064:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383312.662066:0:13796:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787383312.662069:0:13796:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9636064d1800 00000020:00000080:1.0:1787383312.662071:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787383312.662115:0:13796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13796:1874206984880384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383312.662174:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383312.662204:0:13796:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503e7b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383312.662907:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984880384 00000100:00100000:2.0:1787383312.662916:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984880384 00000100:00100000:2.0:1787383312.662966:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787383312.662975:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:13796:x1874206984880384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383312.663118:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:13796:x1874206984880384:12345-0@lo:502:llog_process_th.0 Request processed in 142us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383312.663125:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787383312.663357:0:13796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:68140aec-1198-480f-b348-a4187c7bb1d1:13796:1874206984880384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787383312.663385:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383312.663392:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383312.663394:0:13796:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787383312.663401:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787383312.663678:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787383312.663698:0:6517:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383312.663708:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383312.663719:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383312.704082:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787383313.051839:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383313.461199:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383313.461287:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383313.461673:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965919360 00000100:00100000:3.0:1787383313.461682:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965919360 00000100:00100000:3.0:1787383313.461744:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 213 00000100:00100000:3.0:1787383313.461754:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965919360:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383313.461859:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965919360:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 107us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383313.461866:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 213 00000100:00100000:3.0:1787383313.461919:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383313.462237:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965919616 00000100:00100000:0.0:1787383313.462242:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965919616 00000100:00100000:0.0:1787383313.462272:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 214 00000100:00100000:0.0:1787383313.462279:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206965919616:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383313.462329:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206965919616:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 50us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383313.462336:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 214 00000100:00100000:3.0:1787383313.462677:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383313.462757:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383313.462803:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383313.462824:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965919488 00000100:00100000:3.0:1787383313.462828:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965919488 00000100:00100000:3.0:1787383313.462858:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 102 00000100:00100000:3.0:1787383313.462864:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965919488:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383313.462904:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965919488:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 39us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383313.462911:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 102 00000100:00100000:3.0:1787383313.462949:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965919232 00000100:00100000:3.0:1787383313.462953:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965919232 00000100:00100000:3.0:1787383313.462981:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965919744 00000100:00100000:3.0:1787383313.462985:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965919744 00000100:00080000:1.0:1787383313.463529:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383313.463534:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383313.463536:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383313.463552:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 215 00000100:00100000:1.0:1787383313.463572:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965919232:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383313.463615:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965919232:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 46us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383313.463623:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 215 00000100:00100000:3.0:1787383313.463850:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 216 00000100:00100000:3.0:1787383313.463857:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206965919744:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383313.463885:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206965919744:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 29us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383313.463892:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 216 00000100:00100000:2.0:1787383313.465078:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965919104 00000100:00100000:2.0:1787383313.465091:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965919104 00000100:00100000:2.0:1787383313.465293:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 366 00000100:00100000:2.0:1787383313.465303:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2401:x1874206965919104:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383313.465351:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2401:x1874206965919104:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 50us (4169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383313.465358:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 366 00000100:00080000:0.0:1787383313.465439:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1787383313.691365:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787383313.755620:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787383314.077176:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383314.587219:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984880512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383314.587293:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383314.587427:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984880512 00000100:00100000:0.0:1787383314.587434:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984880512 00000100:00100000:0.0:1787383314.587484:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787383314.587493:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984880512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383314.587535:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787383314.588261:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984880512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 765us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383314.588270:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787383314.588480:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984880512:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787383315.099295:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383315.611001:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984880640:0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.611092:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383315.611104:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984880896:0@lo:400:kworker.0 00000100:00100000:0.0:1787383315.611144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383315.611205:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984880896 00000100:00100000:0.0:1787383315.611211:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984880896 00000100:00100000:1.0:1787383315.611261:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984881152:0@lo:400:kworker.0 00000100:00100000:0.0:1787383315.611262:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787383315.611274:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984880896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.611294:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383315.611309:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984881664:0@lo:400:kworker.0 00000100:00100000:0.0:1787383315.611331:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984880896:12345-0@lo:400:kworker.0 Request processed in 58us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383315.611341:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787383315.611343:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383315.611361:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984881152 00000100:00100000:1.0:1787383315.611365:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984882176:0@lo:400:kworker.0 00000100:00100000:0.0:1787383315.611365:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984881152 00000100:00100000:0.0:1787383315.611390:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787383315.611395:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383315.611399:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984881152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.611418:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787383315.611427:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984880768:0@lo:400:kworker.0 00000100:00100000:0.0:1787383315.611436:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984881152:12345-0@lo:400:kworker.0 Request processed in 38us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383315.611443:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787383315.611457:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383315.611464:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984881664 00000100:00100000:1.0:1787383315.611476:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984881280:0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.611499:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383315.611526:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984881792:0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.611547:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383315.611578:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984881152:0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.611603:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984880768 00000100:00100000:1.0:1787383315.611606:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984880768 00000100:00100000:1.0:1787383315.611642:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984881280 00000100:00100000:1.0:1787383315.611652:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984881280 00000100:00100000:1.0:1787383315.611681:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984881792 00000100:00100000:1.0:1787383315.611684:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984881792 00000100:00100000:1.0:1787383315.611699:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787383315.611704:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984880768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.611741:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984880768:12345-0@lo:400:kworker.0 Request processed in 36us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383315.611748:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787383315.611762:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787383315.611800:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984881280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.611828:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984881280:12345-0@lo:400:kworker.0 Request processed in 29us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383315.611834:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787383315.611846:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787383315.611852:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984881792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.611889:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984881792:12345-0@lo:400:kworker.0 Request processed in 37us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383315.611894:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:1.0:1787383315.611912:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383315.611935:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984880768:0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.611944:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984881280:0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.611952:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984881792:0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.611991:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984880896:0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.611999:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984881408:0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.612046:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383315.612047:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984880640 00000100:00100000:3.0:1787383315.612053:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984880640 00000100:00100000:1.0:1787383315.612067:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984881920:0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.612091:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383315.612099:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1787383315.612108:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984880640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.612115:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787383315.612124:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984881024:0@lo:400:kworker.0 00000100:00100000:3.0:1787383315.612150:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984880640:12345-0@lo:400:kworker.0 Request processed in 43us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383315.612158:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787383315.612162:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383315.612183:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984881536:0@lo:400:kworker.0 00000100:00100000:3.0:1787383315.612190:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984882176 00000100:00100000:3.0:1787383315.612194:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984882176 00000100:00100000:1.0:1787383315.612209:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383315.612228:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963640953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984882048:0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.612253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383315.612585:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984881536 00000100:00100000:3.0:1787383315.612590:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984881536 00000100:00100000:1.0:1787383315.612593:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984881408 00000100:00100000:1.0:1787383315.612600:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984881408 00000100:00100000:3.0:1787383315.612612:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984882048 00000100:00100000:3.0:1787383315.612617:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984882048 00000100:00100000:3.0:1787383315.612635:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787383315.612640:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984882176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383315.612672:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984882176:12345-0@lo:400:kworker.0 Request processed in 32us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383315.612679:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787383315.612680:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984881920 00000100:00100000:1.0:1787383315.612686:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984881920 00000100:00100000:3.0:1787383315.612693:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787383315.612701:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984881536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.612712:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984881024 00000100:00100000:1.0:1787383315.612716:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984881024 00000100:00100000:1.0:1787383315.612729:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787383315.612734:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984881408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.612787:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984881408:12345-0@lo:400:kworker.0 Request processed in 52us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383315.612794:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787383315.612808:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787383315.612813:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984881920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.612842:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984881920:12345-0@lo:400:kworker.0 Request processed in 29us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383315.612849:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787383315.612906:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787383315.612917:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984881024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.612926:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787383315.612935:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984882048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383315.612957:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984881024:12345-0@lo:400:kworker.0 Request processed in 41us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383315.612983:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787383315.612989:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984882048:12345-0@lo:400:kworker.0 Request processed in 54us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383315.612997:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1787383315.613024:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383315.613030:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383315.613032:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787383315.613061:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984881024:0@lo:400:kworker.0 00010000:00080000:1.0:1787383315.613075:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640953100 x1874206984882048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383315.613084:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984882048:0@lo:400:kworker.0 00010000:00080000:1.0:1787383315.613094:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d0e00 x1874206984881408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383315.613102:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984881408:0@lo:400:kworker.0 00010000:00080000:1.0:1787383315.613110:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963640950700 x1874206984881920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383315.613118:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984881920:0@lo:400:kworker.0 00010000:00080000:1.0:1787383315.613204:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350275f480 x1874206984882176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383315.613213:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984882176:0@lo:400:kworker.0 00000100:00100000:1.0:1787383315.613223:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984880640:0@lo:400:kworker.0 00000100:00100000:0.0:1787383315.613345:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984881664 00000100:00100000:0.0:1787383315.613390:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787383315.613397:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874206984881664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383315.613439:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874206984881664:12345-0@lo:400:kworker.0 Request processed in 42us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383315.613445:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787383315.613469:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963640951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984881664:0@lo:400:kworker.0 00000100:00100000:3.0:1787383315.613578:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984881536:12345-0@lo:400:kworker.0 Request processed in 878us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383315.613585:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1787383315.614058:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383315.614652:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984881536:0@lo:400:kworker.0 00000100:00100000:0.0:1787383316.122953:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383316.122978:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984882304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383316.123082:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787383316.123565:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383316.123842:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383316.123856:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350275e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984882432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383316.123893:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383316.124075:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984882304 00000100:00100000:1.0:1787383316.124088:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984882304 00000100:00100000:1.0:1787383316.124126:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984882432 00000100:00100000:1.0:1787383316.124129:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984882432 00000100:00100000:1.0:1787383316.124143:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787383316.124151:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984882304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787383316.124180:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383316.124230:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984882304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383316.124238:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787383316.124254:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787383316.124260:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984882432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383316.124269:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383316.124306:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984882432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383316.124313:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1787383316.124371:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3dc00 x1874206984882304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383316.124390:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984882304:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787383316.124471:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350275e300 x1874206984882432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383316.124485:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350275e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984882432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383316.635048:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383316.635072:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350275f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984882560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383316.635141:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383316.635278:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984882560 00000100:00100000:0.0:1787383316.635286:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984882560 00000100:00100000:0.0:1787383316.635342:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787383316.635351:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984882560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383316.635383:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787383316.635434:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984882560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383316.635440:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787383316.635591:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350275f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984882560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383317.149837:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383317.149860:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350275f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984882688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383317.149922:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383317.149984:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984882688 00000100:00100000:0.0:1787383317.149990:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984882688 00000100:00100000:0.0:1787383317.150053:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787383317.150063:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984882688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787383317.150101:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383317.150139:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984882688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383317.150146:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1787383317.150176:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383317.150207:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350275f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984882688:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787383317.150814:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383317.151218:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984882816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383317.151259:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383317.151399:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984882816 00000100:00100000:2.0:1787383317.151405:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984882816 00000100:00100000:2.0:1787383317.151458:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787383317.151466:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874206984882816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383317.151483:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383317.151519:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874206984882816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383317.151526:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1787383317.151685:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383317.151717:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963622ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984882816:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787383317.154150:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:3.0:1787383318.170990:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383318.580549:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383318.580647:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383318.580687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383318.580740:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965920256 00000100:00100000:2.0:1787383318.580750:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965920256 00000100:00100000:2.0:1787383318.580854:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 107 00000100:00100000:2.0:1787383318.580875:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965920256:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383318.580947:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965920256:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 85us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383318.580955:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 107 00000100:00080000:0.0:1787383318.581025:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383318.581623:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383318.581646:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383318.581688:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965919872 00000100:00100000:0.0:1787383318.581694:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965919872 00000100:00100000:0.0:1787383318.581728:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 368 00000100:00100000:0.0:1787383318.581735:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2402:x1874206965919872:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383318.581794:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2402:x1874206965919872:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 60us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383318.581802:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 368 00000100:00100000:1.0:1787383318.582279:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965920000 00000100:00100000:1.0:1787383318.582285:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965920000 00000100:00100000:1.0:1787383318.582335:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965920512 00000100:00100000:1.0:1787383318.582339:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965920512 00000100:00100000:1.0:1787383318.582363:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 223 00000100:00100000:1.0:1787383318.582371:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965920000:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383318.582412:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965920000:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 41us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383318.582433:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 223 00000100:00100000:1.0:1787383318.582450:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 224 00000100:00100000:1.0:1787383318.582457:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965920512:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383318.582485:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965920512:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 29us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383318.582491:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 224 00000100:00080000:0.0:1787383318.582581:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383318.582585:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383318.583246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383318.583457:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965920128 00000100:00100000:2.0:1787383318.583463:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965920128 00000100:00080000:3.0:1787383318.583534:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383318.583567:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965920384 00000100:00100000:0.0:1787383318.583571:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965920384 00000100:00100000:0.0:1787383318.583614:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 225 00000100:00100000:0.0:1787383318.583622:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965920128:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383318.583667:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965920128:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 46us (2020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383318.583685:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 225 00000100:00100000:0.0:1787383318.583701:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 226 00000100:00100000:0.0:1787383318.583707:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965920384:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383318.583731:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965920384:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 24us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383318.583737:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 226 00000100:00080000:3.0:1787383318.583888:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787383319.194953:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383319.709637:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383319.709661:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984882944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383319.709723:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383319.709834:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984882944 00000100:00100000:0.0:1787383319.709840:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984882944 00000100:00100000:0.0:1787383319.709883:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787383319.709890:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984882944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383319.709923:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787383319.709981:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984882944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383319.709998:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787383319.710199:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984882944:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787383320.218973:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383320.731145:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984883072:0@lo:400:kworker.0 00000100:00100000:1.0:1787383320.731218:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383320.731356:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984883456:0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.731387:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383320.731436:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984883328:0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.731472:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383320.731491:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383320.731497:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984883200:0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.731518:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383320.731545:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984883456 00000100:00100000:0.0:1787383320.731551:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984883456 00000100:00100000:0.0:1787383320.731587:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984883200 00000100:00100000:0.0:1787383320.731590:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984883200 00000100:00100000:0.0:1787383320.731622:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787383320.731629:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350275f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984883456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.731691:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350275f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984883456:12345-0@lo:400:kworker.0 Request processed in 61us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383320.731699:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787383320.731715:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787383320.731721:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984883200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.731749:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984883200:12345-0@lo:400:kworker.0 Request processed in 28us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383320.731754:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787383320.731793:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984883072 00000100:00100000:3.0:1787383320.731799:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984883072 00000100:00100000:0.0:1787383320.731804:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984883328 00000100:00100000:0.0:1787383320.731809:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984883328 00000100:00100000:3.0:1787383320.731837:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1787383320.731845:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787383320.731848:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984883072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.731856:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984883328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.731887:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984883328:12345-0@lo:400:kworker.0 Request processed in 35us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383320.731892:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787383320.731937:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984883456:0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.731961:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984883200:0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.731968:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984883328:0@lo:400:kworker.0 00000100:00100000:3.0:1787383320.732680:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984883072:12345-0@lo:400:kworker.0 Request processed in 821us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383320.732691:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1787383320.732746:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984883712:0@lo:400:kworker.0 00000100:00100000:3.0:1787383320.732813:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383320.732823:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984883840:0@lo:400:kworker.0 00000100:00100000:3.0:1787383320.732856:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984884224:0@lo:400:kworker.0 00000100:00100000:2.0:1787383320.732863:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383320.732888:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383320.732891:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984884352:0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.732961:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984883968:0@lo:400:kworker.0 00000100:00100000:2.0:1787383320.733612:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383320.733631:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984883712 00000100:00100000:3.0:1787383320.733640:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984883712 00000100:00100000:2.0:1787383320.733654:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984883840 00000100:00100000:2.0:1787383320.733671:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984883840 00000100:00100000:3.0:1787383320.733686:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984884224 00000100:00100000:3.0:1787383320.733692:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984884224 00000100:00100000:2.0:1787383320.733700:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984884352 00000100:00100000:2.0:1787383320.733705:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984884352 00000100:00100000:3.0:1787383320.733719:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787383320.733729:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984883712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383320.733794:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984883712:12345-0@lo:400:kworker.0 Request processed in 66us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383320.733894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383320.733916:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984884480:0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.733939:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383320.733970:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787383320.733987:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96364098ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984883584:0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.734013:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383320.734060:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984883072:0@lo:400:kworker.0 00000100:00100000:1.0:1787383320.734097:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984883968 00000100:00100000:1.0:1787383320.734101:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984883968 00000100:00100000:1.0:1787383320.734128:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984884480 00000100:00100000:1.0:1787383320.734131:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984884480 00000100:00100000:1.0:1787383320.734151:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787383320.734158:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984883968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383320.734193:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984883968:12345-0@lo:400:kworker.0 Request processed in 35us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383320.734200:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787383320.734214:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787383320.734221:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984884480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.734280:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984884096:0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.734303:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383320.734314:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984884608:0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.734332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383320.734365:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984883968:0@lo:400:kworker.0 00010000:00080000:0.0:1787383320.734377:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d91a680 x1874206984884480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383320.734386:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984884480:0@lo:400:kworker.0 00000100:00100000:1.0:1787383320.734949:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984884480:12345-0@lo:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383320.735007:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787383320.735047:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984884096 00000100:00100000:1.0:1787383320.735051:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984884096 00000100:00100000:0.0:1787383320.735070:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984884608 00000100:00100000:0.0:1787383320.735099:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984884608 00000100:00100000:1.0:1787383320.735127:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787383320.735155:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984884096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.735248:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787383320.735278:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984884096:12345-0@lo:400:kworker.0 Request processed in 145us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383320.735295:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984884608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383320.735304:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787383320.735573:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787383320.735580:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff963503173b80, transno 4294967301 00000100:00100000:1.0:1787383320.735592:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984884096:0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.735747:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984884608:12345-0@lo:400:kworker.0 Request processed in 491us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383320.735754:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787383320.735807:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984883584 00000100:00100000:0.0:1787383320.735811:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984883584 00000100:00100000:0.0:1787383320.735834:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787383320.735839:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984883584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383320.735869:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984883584:12345-0@lo:400:kworker.0 Request processed in 31us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383320.735875:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787383320.735920:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984883584:0@lo:400:kworker.0 00010000:00080000:0.0:1787383320.735931:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d919500 x1874206984884608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383320.735941:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984884608:0@lo:400:kworker.0 00000100:00100000:2.0:1787383320.736100:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787383320.736109:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984883840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383320.736147:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984883840:12345-0@lo:400:kworker.0 Request processed in 40us (3288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383320.736152:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787383320.736164:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787383320.736170:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350338a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984884224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383320.736192:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350338a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984884224:12345-0@lo:400:kworker.0 Request processed in 24us (3305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383320.736198:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787383320.736207:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787383320.736212:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984884352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383320.736232:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984884352:12345-0@lo:400:kworker.0 Request processed in 20us (2623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383320.736237:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00010000:00080000:2.0:1787383320.736260:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96364098d880 x1874206984883840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383320.736270:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984883840:0@lo:400:kworker.0 00010000:00080000:2.0:1787383320.736279:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d919c00 x1874206984884352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383320.736298:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984884352:0@lo:400:kworker.0 00000100:00080000:2.0:1787383320.736325:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383320.736329:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383320.736332:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383320.736334:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383320.736356:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984884224:0@lo:400:kworker.0 00000100:00100000:2.0:1787383320.736365:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96364098f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984883712:0@lo:400:kworker.0 00000100:00100000:3.0:1787383320.738017:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787383321.243003:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383321.243025:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984884736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383321.243094:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383321.243220:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984884736 00000100:00100000:1.0:1787383321.243228:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984884736 00000100:00100000:1.0:1787383321.243288:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787383321.243297:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984884736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787383321.243324:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383321.243364:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984884736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383321.243371:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787383321.243884:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383321.243898:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984884864:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787383321.243911:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383321.243937:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383321.244237:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984884864 00000100:00100000:2.0:1787383321.244242:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984884864 00000100:00100000:2.0:1787383321.244311:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787383321.244319:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984884864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383321.244333:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383321.244452:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984884864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383321.244459:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1787383321.244506:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503173b80 x1874206984884864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383321.244523:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984884864:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787383321.248739:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d3dc00 x1874206984884736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383321.248783:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984884736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383321.758110:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787383321.758132:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984884992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383321.758192:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383321.758251:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984884992 00000100:00100000:0.0:1787383321.758257:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984884992 00000100:00100000:0.0:1787383321.758299:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787383321.758307:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984884992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383321.758617:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787383321.758669:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984884992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 360us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383321.758676:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787383321.760020:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984884992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383322.267415:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984885120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383322.267491:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383322.268034:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984885120 00000100:00100000:0.0:1787383322.268042:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984885120 00000100:00080000:2.0:1787383322.268071:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383322.268095:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787383322.268105:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984885120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787383322.268146:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383322.268202:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984885120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383322.268209:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00010000:3.0:1787383322.268441:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383322.268733:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383322.268747:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984885248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383322.268809:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383322.268837:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984885248 00000100:00100000:0.0:1787383322.268841:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984885248 00000100:00100000:0.0:1787383322.268871:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787383322.268876:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984885248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383322.268888:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383322.268918:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984885248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383322.268924:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1787383322.268937:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383322.268978:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984885248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383322.269024:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984885120:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787383323.294278:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383323.701660:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383323.701706:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383323.701738:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383323.701844:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965920896 00000100:00100000:3.0:1787383323.701853:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965920896 00000100:00100000:3.0:1787383323.701920:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965921152 00000100:00100000:3.0:1787383323.701923:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965921152 00000100:00100000:3.0:1787383323.701948:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 233 00000100:00100000:3.0:1787383323.701967:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965920896:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383323.701988:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 234 00000100:00100000:2.0:1787383323.702003:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965921152:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383323.702040:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965920896:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 84us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383323.702047:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965921152:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 47us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383323.702056:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 234 00000100:00100000:3.0:1787383323.702066:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 233 00000100:00100000:1.0:1787383323.702140:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965920640 00000100:00100000:1.0:1787383323.702145:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965920640 00000100:00100000:1.0:1787383323.702814:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 370 00000100:00100000:1.0:1787383323.702992:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965920640:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383323.703047:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965920640:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 226us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383323.703054:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 370 00000100:00080000:0.0:1787383323.704304:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383323.704313:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383323.713719:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383323.713860:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383323.713913:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383323.714002:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965921024 00000100:00100000:2.0:1787383323.714012:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965921024 00000100:00100000:2.0:1787383323.714100:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 112 00000100:00100000:2.0:1787383323.714109:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965921024:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383323.714183:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965921024:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 74us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383323.714191:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 112 00000100:00080000:3.0:1787383323.714229:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383323.734188:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965920768 00000100:00100000:1.0:1787383323.734206:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965920768 00000100:00100000:1.0:1787383323.734306:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965921280 00000100:00100000:1.0:1787383323.734310:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965921280 00000100:00100000:1.0:1787383323.734344:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 235 00000100:00100000:1.0:1787383323.734354:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965920768:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383323.734431:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965920768:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 79us (20722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383323.734439:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 235 00000100:00080000:3.0:1787383323.734442:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787383323.734449:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383323.734469:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 236 00000100:00100000:1.0:1787383323.734477:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965921280:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383323.734498:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965921280:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (20586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383323.734503:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 236 00000040:00080000:3.0:1787383323.932604:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787383323.996751:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787383324.319038:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383324.827017:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984885376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383324.827090:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383324.827282:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984885376 00000100:00100000:3.0:1787383324.827291:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984885376 00000100:00100000:3.0:1787383324.827345:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787383324.827356:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984885376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787383324.827389:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787383324.827438:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984885376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383324.827445:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787383324.827566:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984885376:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787383325.339144:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383325.850990:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984885504:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.850997:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984885632:0@lo:400:kworker.0 00000100:00100000:2.0:1787383325.851128:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984885760:0@lo:400:kworker.0 00000100:00100000:1.0:1787383325.851202:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984885888:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.853683:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383325.853780:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984886144:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.853840:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383325.853869:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984886656:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.853893:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383325.853919:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787383325.853926:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984886016:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.853961:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383325.854475:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984886528:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.854511:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383325.854533:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984887040:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.854555:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383325.854593:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984886528 00000100:00100000:0.0:1787383325.854601:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984886528 00000100:00100000:0.0:1787383325.854651:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984887040 00000100:00100000:0.0:1787383325.854654:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984887040 00000100:00100000:0.0:1787383325.854676:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787383325.854685:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984886528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.854738:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984886528:12345-0@lo:400:kworker.0 Request processed in 54us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383325.854745:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787383325.854760:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787383325.854801:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984887040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.854831:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984887040:12345-0@lo:400:kworker.0 Request processed in 31us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383325.854837:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787383325.854863:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984885632 00000100:00100000:0.0:1787383325.854866:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984885632 00000100:00100000:0.0:1787383325.854891:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984886144 00000100:00100000:0.0:1787383325.854894:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984886144 00000100:00100000:0.0:1787383325.854909:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984886656 00000100:00100000:0.0:1787383325.854911:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984886656 00000100:00100000:0.0:1787383325.854925:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787383325.854930:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984885632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.857549:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984885632:12345-0@lo:400:kworker.0 Request processed in 2609us (3864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383325.857563:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787383325.857597:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787383325.857608:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984886144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.857673:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984886144:12345-0@lo:400:kworker.0 Request processed in 68us (3832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383325.857679:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787383325.857692:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787383325.857699:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984886656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.857725:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984886656:12345-0@lo:400:kworker.0 Request processed in 27us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383325.857731:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:0.0:1787383325.857759:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383325.857778:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383325.857801:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383325.857852:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984886528:0@lo:400:kworker.0 00010000:00080000:0.0:1787383325.857867:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636012aea00 x1874206984887040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383325.857877:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984887040:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.857888:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984886144:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.857898:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984886656:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.857908:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984885632:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.858083:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984886016 00000100:00100000:0.0:1787383325.858089:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984886016 00000100:00100000:0.0:1787383325.858128:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787383325.858134:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984886016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.858172:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984886016:12345-0@lo:400:kworker.0 Request processed in 38us (4210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383325.858178:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787383325.858206:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984886016:0@lo:400:kworker.0 00000100:00100000:3.0:1787383325.859311:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383325.859351:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984885504 00000100:00100000:3.0:1787383325.859357:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984885504 00000100:00100000:2.0:1787383325.859367:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383325.859403:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787383325.859405:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984885760 00000100:00100000:2.0:1787383325.859410:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984885760 00000100:00100000:3.0:1787383325.859414:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984885504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383325.859448:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787383325.859458:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984885760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383325.859464:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383325.859465:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984885504:12345-0@lo:400:kworker.0 Request processed in 51us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383325.859475:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1787383325.859502:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984885888 00000100:00100000:1.0:1787383325.859507:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984885888 00000100:00100000:2.0:1787383325.859512:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984885760:12345-0@lo:400:kworker.0 Request processed in 55us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383325.859520:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787383325.859539:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984885504:0@lo:400:kworker.0 00000100:00100000:2.0:1787383325.859556:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984885760:0@lo:400:kworker.0 00000100:00100000:2.0:1787383325.859567:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984886272:0@lo:400:kworker.0 00000100:00100000:2.0:1787383325.859591:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383325.859605:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984886784:0@lo:400:kworker.0 00000100:00100000:2.0:1787383325.859620:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383325.859637:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984886272 00000100:00100000:2.0:1787383325.859640:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984886272 00000100:00100000:3.0:1787383325.859677:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984886784 00000100:00100000:2.0:1787383325.859681:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787383325.859683:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984886784 00000100:00100000:2.0:1787383325.859690:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984886272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383325.859722:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787383325.859727:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984886272:12345-0@lo:400:kworker.0 Request processed in 36us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383325.859733:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984886784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383325.859746:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:2.0:1787383325.859763:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787383325.859811:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d91a680 x1874206984886272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383325.859821:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984886272:0@lo:400:kworker.0 00010000:00080000:2.0:1787383325.859839:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636012ac700 x1874206984886784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383325.859842:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984886784:12345-0@lo:400:kworker.0 Request processed in 109us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383325.859849:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984886784:0@lo:400:kworker.0 00000100:00100000:3.0:1787383325.859862:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787383325.860745:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787383325.860755:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984885888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383325.861048:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984885888:12345-0@lo:400:kworker.0 Request processed in 295us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383325.861056:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787383325.861098:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984885888:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.861108:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984886400:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.861142:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383325.861169:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984886912:0@lo:400:kworker.0 00000100:00100000:2.0:1787383325.861192:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984886400 00000100:00100000:0.0:1787383325.861193:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383325.861199:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984886400 00000100:00100000:2.0:1787383325.861247:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984886912 00000100:00100000:2.0:1787383325.861251:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984886912 00000100:00100000:0.0:1787383325.861257:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787383325.861267:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984886400:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787383325.861315:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383325.861319:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383325.861403:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787383325.861412:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984886912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383325.863015:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984886912:12345-0@lo:400:kworker.0 Request processed in 1599us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383325.863027:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787383325.864250:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984886400:0@lo:400:kworker.0 00010000:00080000:1.0:1787383325.864271:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636012ad880 x1874206984886912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383325.864282:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984886912:0@lo:400:kworker.0 00000100:00100000:0.0:1787383325.864305:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984886400:12345-0@lo:400:kworker.0 Request processed in 3037us (3159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383325.864315:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00010000:3.0:1787383326.363332:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383326.363343:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383326.363362:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963635362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984887168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383326.363426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383326.364352:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984887168 00000100:00100000:0.0:1787383326.364362:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984887168 00000100:00100000:0.0:1787383326.364415:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787383326.364425:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984887168:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383326.364426:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383326.364442:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984887296:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383326.364458:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383326.364487:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383326.364600:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787383326.364608:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787383326.368861:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984887296 00000100:00100000:2.0:1787383326.368875:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984887296 00000100:00100000:3.0:1787383326.369175:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787383326.369187:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984887296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383326.369253:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383326.369369:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984887296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (4881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383326.369391:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1787383326.369457:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635037d0e00 x1874206984887296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383326.369478:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984887296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383326.385469:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984887168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 21036us (22033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383326.385484:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1787383326.385631:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963635362300 x1874206984887168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383326.385655:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963635362300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984887168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383326.875598:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383326.875622:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963635363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984887424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383326.875691:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383326.876467:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984887424 00000100:00100000:2.0:1787383326.876476:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984887424 00000100:00100000:2.0:1787383326.876533:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787383326.876542:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984887424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383326.876585:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787383326.876661:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984887424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383326.876740:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787383326.876815:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963635363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984887424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383327.387250:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383327.387274:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963635362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984887552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383327.387351:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383327.387426:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984887680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383327.387453:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383327.387482:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984887552 00000100:00100000:3.0:1787383327.387490:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984887552 00000100:00100000:3.0:1787383327.387551:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984887680 00000100:00100000:3.0:1787383327.387554:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984887680 00000100:00100000:3.0:1787383327.387576:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787383327.387584:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984887552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787383327.387610:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787383327.387633:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383327.387673:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984887552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383327.387682:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787383327.387703:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787383327.387707:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963635362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984887552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383327.387714:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963640953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984887680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383327.387725:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383327.387786:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963640953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984887680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383327.387793:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787383327.387849:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984887680:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787383327.389344:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383328.411059:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383328.820880:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383328.820943:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383328.820965:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965921408 00000100:00100000:2.0:1787383328.820975:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965921408 00000100:00100000:0.0:1787383328.820986:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383328.821051:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 372 00000100:00100000:3.0:1787383328.821058:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965921664 00000100:00100000:2.0:1787383328.821070:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965921408:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383328.821074:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965921664 00000100:00100000:1.0:1787383328.821119:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965921536 00000100:00100000:1.0:1787383328.821141:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965921536 00000100:00100000:3.0:1787383328.821184:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 243 00000100:00100000:1.0:1787383328.821205:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 244 00000100:00100000:3.0:1787383328.821206:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965921664:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383328.821224:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965921536:12345-192.168.203.2@tcp:400:kworker.0 00000100:00080000:0.0:1787383328.821346:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383328.821353:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383328.821443:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965921664:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 247us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383328.821453:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 243 00000100:00100000:2.0:1787383328.822578:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965921408:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 1508us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383328.822592:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 372 00000100:00100000:1.0:1787383328.824330:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965921536:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 3105us (3335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383328.824344:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 244 00000100:00100000:1.0:1787383328.839271:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383328.839338:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383328.839522:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965921920 00000100:00100000:0.0:1787383328.839535:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965921920 00000100:00100000:0.0:1787383328.839631:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965922048 00000100:00100000:0.0:1787383328.839635:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965922048 00000100:00100000:0.0:1787383328.839665:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 245 00000100:00100000:0.0:1787383328.839675:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965921920:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383328.839803:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965921920:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 128us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383328.839812:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 245 00000100:00100000:0.0:1787383328.839832:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 246 00000100:00100000:0.0:1787383328.839839:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965922048:12345-192.168.203.2@tcp:400:kworker.0 00000100:00080000:1.0:1787383328.840016:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383328.840021:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383328.840135:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965922048:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 294us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383328.840143:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 246 00000100:00100000:0.0:1787383328.845867:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383328.847175:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965921792 00000100:00100000:1.0:1787383328.847193:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965921792 00000100:00100000:1.0:1787383328.847345:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:1.0:1787383328.847358:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2400:x1874206965921792:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:1.0:1787383328.847399:0:8914:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e6b6 00000100:00080000:1.0:1787383328.847412:0:8914:0:(import.c:65:import_set_state_nolock()) ffff9635034f7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787383328.847497:0:8914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1787383328.847719:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+2:2400:x1874206965921792:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 362us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383328.847728:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00010000:00010000:3.0:1787383328.848972:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787383328.850730:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787383329.436301:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383329.947206:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383329.947310:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984887808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383329.947397:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383329.947610:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984887808 00000100:00100000:2.0:1787383329.947621:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984887808 00000100:00100000:2.0:1787383329.947716:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787383329.947727:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984887808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787383329.947793:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787383329.947849:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984887808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383329.947857:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787383329.947966:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984887808:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787383330.458985:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383330.971062:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984887936:0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.971111:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984888320:0@lo:400:kworker.0 00000100:00100000:2.0:1787383330.971203:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984888064:0@lo:400:kworker.0 00000100:00100000:1.0:1787383330.971262:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984888192:0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.971748:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383330.971829:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984888832:0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.971871:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383330.971891:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984889344:0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.971949:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383330.971970:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787383330.971976:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984888448:0@lo:400:kworker.0 00000100:00100000:0.0:1787383330.972194:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383330.972282:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984888832 00000100:00100000:0.0:1787383330.972294:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984888832 00000100:00100000:3.0:1787383330.972364:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383330.972368:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984889344 00000100:00100000:0.0:1787383330.972374:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984889344 00000100:00100000:3.0:1787383330.972402:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984888960:0@lo:400:kworker.0 00000100:00100000:0.0:1787383330.972415:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787383330.972428:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984888832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.972437:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383330.972455:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984889472:0@lo:400:kworker.0 00000100:00100000:0.0:1787383330.972510:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984888832:12345-0@lo:400:kworker.0 Request processed in 83us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383330.972520:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787383330.972572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383330.972597:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984888576:0@lo:400:kworker.0 00000100:00100000:2.0:1787383330.972621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383330.972642:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984889088:0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.972653:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383330.973055:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383330.973062:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984888832:0@lo:400:kworker.0 00000100:00100000:2.0:1787383330.973107:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984888960 00000100:00100000:2.0:1787383330.973124:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984888960 00000100:00100000:3.0:1787383330.973624:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984887936 00000100:00100000:3.0:1787383330.973631:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984887936 00000100:00100000:3.0:1787383330.973673:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787383330.973682:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984887936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383330.973897:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984889472 00000100:00100000:0.0:1787383330.973917:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984889472 00000100:00100000:3.0:1787383330.974250:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984887936:12345-0@lo:400:kworker.0 Request processed in 568us (2058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383330.974260:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787383330.974626:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984888448 00000100:00100000:3.0:1787383330.974633:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984888448 00000100:00100000:3.0:1787383330.974671:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787383330.974678:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984888448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.974851:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984888448:12345-0@lo:400:kworker.0 Request processed in 165us (2542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383330.974858:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787383330.974917:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984888448:0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.974963:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984888320 00000100:00100000:3.0:1787383330.974979:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984888320 00000100:00100000:3.0:1787383330.975291:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984888064 00000100:00100000:3.0:1787383330.975295:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984888064 00000100:00100000:3.0:1787383330.975378:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984888576 00000100:00100000:3.0:1787383330.975381:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984888576 00000100:00100000:3.0:1787383330.975399:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984889088 00000100:00100000:3.0:1787383330.975402:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984889088 00000100:00100000:3.0:1787383330.975418:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787383330.975424:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984888320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.975582:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984888320:12345-0@lo:400:kworker.0 Request processed in 157us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383330.975590:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787383330.975605:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787383330.975611:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984888064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.975649:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984888064:12345-0@lo:400:kworker.0 Request processed in 38us (3078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383330.975654:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787383330.975667:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787383330.975673:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984888576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.975717:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984888576:12345-0@lo:400:kworker.0 Request processed in 44us (3095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383330.975723:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787383330.975734:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787383330.975741:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984889088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.975795:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984889088:12345-0@lo:400:kworker.0 Request processed in 55us (2741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383330.975802:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787383330.976048:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984888320:0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.976246:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984888064:0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.976260:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984888576:0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.976275:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984889088:0@lo:400:kworker.0 00000100:00080000:3.0:1787383330.976385:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383330.976391:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383330.976394:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383330.976551:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787383330.976561:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984889344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383330.976607:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984889344:12345-0@lo:400:kworker.0 Request processed in 49us (4658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383330.976613:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787383330.976729:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383330.976782:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984888192 00000100:00100000:1.0:1787383330.976789:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984888192 00000100:00100000:1.0:1787383330.976825:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787383330.976831:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984888192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383330.976865:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984888192:12345-0@lo:400:kworker.0 Request processed in 34us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383330.976880:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787383330.976930:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984888192:0@lo:400:kworker.0 00000100:00100000:1.0:1787383330.976941:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984888704:0@lo:400:kworker.0 00000100:00100000:1.0:1787383330.976974:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383330.976997:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984888704 00000100:00100000:1.0:1787383330.977001:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984888704 00000100:00100000:1.0:1787383330.977032:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787383330.977038:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984888704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383330.977071:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984888704:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383330.977078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:1.0:1787383330.977093:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787383330.977115:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636012afb80 x1874206984888704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383330.977126:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984888704:0@lo:400:kworker.0 00000100:00100000:1.0:1787383330.977133:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984889216:0@lo:400:kworker.0 00000100:00100000:1.0:1787383330.977155:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383330.977172:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984889216 00000100:00100000:1.0:1787383330.977176:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984889216 00000100:00100000:1.0:1787383330.977202:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787383330.977208:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984889216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383330.977237:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984889216:12345-0@lo:400:kworker.0 Request processed in 29us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383330.977243:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:1.0:1787383330.977263:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787383330.977280:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636012ad880 x1874206984889216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383330.977290:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984889216:0@lo:400:kworker.0 00000100:00100000:1.0:1787383330.977334:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984887936:0@lo:400:kworker.0 00010000:00080000:1.0:1787383330.977375:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636012ad180 x1874206984889344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383330.977384:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984889344:0@lo:400:kworker.0 00000100:00100000:2.0:1787383330.977655:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787383330.978035:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984888960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383330.978087:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984888960:12345-0@lo:400:kworker.0 Request processed in 61us (5651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383330.978094:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787383330.978125:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984888960:0@lo:400:kworker.0 00000100:00100000:0.0:1787383330.980329:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787383330.980363:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984889472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383330.980491:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984889472:12345-0@lo:400:kworker.0 Request processed in 147us (7839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383330.980500:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:2.0:1787383330.983315:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636012af800 x1874206984889472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383330.984023:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984889472:0@lo:400:kworker.0 00010000:00010000:0.0:1787383331.482944:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383331.483430:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963635363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984889728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383331.483498:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383331.483573:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383331.483580:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984889600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383331.483605:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383331.483678:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984889728 00000100:00100000:1.0:1787383331.483686:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984889728 00000100:00100000:1.0:1787383331.483735:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984889600 00000100:00100000:1.0:1787383331.483738:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984889600 00000100:00100000:1.0:1787383331.483828:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787383331.483839:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984889728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787383331.483872:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383331.483881:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787383331.483894:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984889600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383331.483926:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383331.483935:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984889728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383331.483944:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787383331.483966:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984889600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383331.483975:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:1.0:1787383331.483989:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362da09500 x1874206984889600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383331.484010:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984889600:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787383331.484022:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963635363480 x1874206984889728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383331.484035:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963635363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984889728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383331.996466:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383331.996499:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963635363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984889856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383331.996566:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383331.996804:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984889856 00000100:00100000:0.0:1787383331.996813:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984889856 00000100:00100000:0.0:1787383331.996876:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787383331.996884:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984889856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383331.996926:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787383331.996977:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984889856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383331.996984:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787383331.997030:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963635363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984889856:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787383332.506893:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383332.516872:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984889984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383332.516963:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383332.517047:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984889984 00000100:00100000:1.0:1787383332.517055:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984889984 00000100:00100000:1.0:1787383332.517116:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787383332.517126:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984889984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383332.517154:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383332.517198:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984889984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383332.517205:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1787383332.517225:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383332.517260:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984889984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383332.518106:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984890112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383332.518148:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383332.518341:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984890112 00000100:00100000:3.0:1787383332.518349:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984890112 00000100:00100000:3.0:1787383332.518399:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787383332.518407:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984890112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383332.518425:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383332.518464:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984890112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383332.518471:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787383332.518509:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984890112:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787383332.518583:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787383333.148185:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787383333.211488:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787383333.531149:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383333.942339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383333.942386:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383333.942528:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965922304 00000100:00100000:3.0:1787383333.942539:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965922304 00000100:00100000:3.0:1787383333.942620:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 253 00000100:00100000:0.0:1787383333.942916:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965922176 00000100:00080000:2.0:1787383333.943104:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383333.943168:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965922176 00000100:00100000:0.0:1787383333.943342:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 374 00000100:00100000:0.0:1787383333.943352:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2403:x1874206965922176:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383333.943422:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2403:x1874206965922176:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 73us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383333.943430:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 374 00000100:00100000:2.0:1787383333.943790:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965922304:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383333.944071:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965922304:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 1441us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383333.944078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 253 00000100:00100000:1.0:1787383333.946956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383333.946995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383333.947031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383333.947057:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965922432 00000100:00100000:1.0:1787383333.947065:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965922432 00000100:00080000:2.0:1787383333.947097:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383333.947112:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965922560 00000100:00100000:1.0:1787383333.947116:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965922560 00000100:00100000:1.0:1787383333.947145:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965922688 00000100:00100000:1.0:1787383333.947148:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965922688 00000100:00100000:1.0:1787383333.947173:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 254 00000100:00100000:1.0:1787383333.947182:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965922432:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383333.947246:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965922432:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 66us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383333.947254:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 254 00000100:00100000:1.0:1787383333.947271:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 255 00000100:00100000:1.0:1787383333.947277:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965922560:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383333.947302:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965922560:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383333.947308:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 255 00000100:00100000:1.0:1787383333.947319:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 256 00000100:00100000:1.0:1787383333.947324:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965922688:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383333.947348:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965922688:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383333.947353:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 256 00000100:00080000:2.0:1787383333.947836:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383333.947847:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787383334.555166:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383335.068233:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000001:00100000:3.0:1787383335.072630:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000020:00000080:3.0:1787383335.072645:0:8429:0:(genops.c:906:class_export_put()) final put ffff9635034f6000/a75c5b6d-4c9e-4295-9df6-097efce92717 00000020:00000080:1.0:1787383335.072816:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9635034f6000/a75c5b6d-4c9e-4295-9df6-097efce92717 for lustre-OST0000 00000020:00000080:1.0:1787383335.072892:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9635034f7800 for lustre-OST0000 00000100:00100000:0.0:1787383335.073121:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984890240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383335.073233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383335.084673:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984890240 00000100:00100000:1.0:1787383335.084695:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984890240 00000100:00100000:1.0:1787383335.084801:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787383335.084815:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984890240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383335.084876:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383335.085009:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984890240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 196us (11775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383335.085017:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787383335.085238:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984890240:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787383335.578918:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383336.092204:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984890368:0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.092321:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383336.092408:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984890880:0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.092447:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383336.092475:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984891392:0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.092516:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383336.092538:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984891904:0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.092565:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383336.092597:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984890752:0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.092597:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787383336.092612:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984890496:0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.092663:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383336.092692:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383336.092695:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984891008:0@lo:400:kworker.0 00000100:00100000:2.0:1787383336.093635:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984890624:0@lo:400:kworker.0 00000100:00100000:1.0:1787383336.095337:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984890496 00000100:00100000:1.0:1787383336.095358:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984890496 00000100:00100000:1.0:1787383336.095429:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984890752 00000100:00100000:1.0:1787383336.095432:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984890752 00000100:00100000:1.0:1787383336.095457:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787383336.095467:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984890496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.096007:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383336.096061:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984891520:0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.096097:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383336.096132:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984890368 00000100:00100000:0.0:1787383336.096138:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984890368 00000100:00100000:0.0:1787383336.096175:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787383336.096182:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963620ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984890368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.096223:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963620ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984890368:12345-0@lo:400:kworker.0 Request processed in 41us (3907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383336.096231:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1787383336.096286:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984890880 00000100:00100000:0.0:1787383336.096304:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984890880 00000100:00100000:0.0:1787383336.096333:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787383336.096339:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984890880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.096373:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984890880:12345-0@lo:400:kworker.0 Request processed in 34us (3927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383336.096379:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787383336.096400:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984891392 00000100:00100000:0.0:1787383336.096404:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984891392 00000100:00100000:0.0:1787383336.096437:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984891904 00000100:00100000:0.0:1787383336.096440:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984891904 00000100:00100000:0.0:1787383336.096459:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787383336.096466:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984891392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.096496:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984891392:12345-0@lo:400:kworker.0 Request processed in 31us (3981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383336.096502:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787383336.096512:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787383336.096517:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984891904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.096543:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984891904:12345-0@lo:400:kworker.0 Request processed in 26us (3979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383336.096549:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787383336.096567:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984891008 00000100:00100000:0.0:1787383336.096571:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984891008 00000100:00100000:0.0:1787383336.096589:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984891520 00000100:00100000:0.0:1787383336.096592:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984891520 00000100:00100000:0.0:1787383336.096607:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787383336.096613:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984890752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.096647:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984890752:12345-0@lo:400:kworker.0 Request processed in 34us (3960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383336.096664:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787383336.096681:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787383336.096687:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984891008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.096718:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984891008:12345-0@lo:400:kworker.0 Request processed in 32us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383336.096724:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787383336.096735:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787383336.096740:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984891520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.096793:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984891520:12345-0@lo:400:kworker.0 Request processed in 25us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383336.096799:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:0.0:1787383336.097135:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383336.097142:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383336.097144:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383336.097198:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984891008:0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.097211:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984891520:0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.097223:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984890880:0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.097235:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984891392:0@lo:400:kworker.0 00010000:00080000:0.0:1787383336.097250:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636012aca80 x1874206984891904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383336.097260:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984891904:0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.097269:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984890368:0@lo:400:kworker.0 00000100:00100000:2.0:1787383336.101202:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383336.101289:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984891136:0@lo:400:kworker.0 00000100:00100000:2.0:1787383336.101343:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383336.101368:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984891648:0@lo:400:kworker.0 00000100:00100000:2.0:1787383336.101391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383336.101447:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984891136 00000100:00100000:2.0:1787383336.101456:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984891136 00000100:00100000:2.0:1787383336.101515:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984891648 00000100:00100000:2.0:1787383336.101519:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984891648 00000100:00100000:2.0:1787383336.101540:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787383336.101549:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984891136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383336.101615:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984891136:12345-0@lo:400:kworker.0 Request processed in 65us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383336.101623:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787383336.101643:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787383336.101650:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984891648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383336.101678:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984891648:12345-0@lo:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383336.101684:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:2.0:1787383336.101703:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787383336.102156:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636012ac700 x1874206984891136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383336.102197:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984891136:0@lo:400:kworker.0 00010000:00080000:2.0:1787383336.102212:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636012ace00 x1874206984891648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383336.102220:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984891648:0@lo:400:kworker.0 00000100:00100000:3.0:1787383336.102456:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984890752:0@lo:400:kworker.0 00000100:00100000:3.0:1787383336.102484:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984891264:0@lo:400:kworker.0 00000100:00100000:3.0:1787383336.102556:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383336.102587:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984890496:12345-0@lo:400:kworker.0 Request processed in 7117us (9920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383336.102600:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787383336.102613:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984891776:0@lo:400:kworker.0 00000100:00100000:3.0:1787383336.102643:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383336.102733:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984890496:0@lo:400:kworker.0 00000100:00100000:1.0:1787383336.104109:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984891264 00000100:00100000:1.0:1787383336.104121:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984891264 00000100:00100000:1.0:1787383336.104200:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984891776 00000100:00100000:1.0:1787383336.104205:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984891776 00000100:00100000:1.0:1787383336.104235:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787383336.104244:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984891264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383336.104331:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984891264:12345-0@lo:400:kworker.0 Request processed in 88us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383336.104338:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787383336.104353:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787383336.104360:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984891776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383336.104388:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984891776:12345-0@lo:400:kworker.0 Request processed in 28us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383336.104394:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1787383336.104416:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383336.104421:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383336.104453:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984891264:0@lo:400:kworker.0 00010000:00080000:1.0:1787383336.104470:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636012af480 x1874206984891776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383336.104497:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984891776:0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.104671:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984890624 00000100:00100000:0.0:1787383336.104684:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984890624 00000100:00100000:0.0:1787383336.104728:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787383336.104737:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984890624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383336.104808:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984890624:12345-0@lo:400:kworker.0 Request processed in 73us (3613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383336.104815:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787383336.104853:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984890624:0@lo:400:kworker.0 00010000:00010000:0.0:1787383336.605288:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383336.615064:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984892032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383336.615160:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383336.615835:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383336.615860:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984892160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383336.615944:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383336.616141:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984892032 00000100:00100000:3.0:1787383336.616151:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984892032 00000100:00100000:1.0:1787383336.617282:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984892160 00000100:00100000:1.0:1787383336.617297:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984892160 00000100:00100000:1.0:1787383336.617347:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787383336.617359:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984892032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787383336.617404:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383336.617535:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984892032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 178us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383336.617544:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787383336.617578:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787383336.617586:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984892160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383336.617598:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383336.617634:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984892160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383336.617641:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:3.0:1787383336.619750:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636012af800 x1874206984892160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383336.619794:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984892160:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787383336.625107:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cd1880 x1874206984892032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383336.625149:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984892032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383337.115143:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383337.115177:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984892288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383337.115273:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383337.115462:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984892288 00000100:00100000:0.0:1787383337.115472:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984892288 00000100:00100000:0.0:1787383337.115538:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787383337.115548:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984892288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383337.115601:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787383337.115668:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984892288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383337.115676:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787383337.115891:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984892288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383337.628204:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984892416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383337.628270:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383337.631388:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984892416 00000100:00100000:1.0:1787383337.631402:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984892416 00000100:00100000:1.0:1787383337.631454:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787383337.631464:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984892416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383337.631494:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383337.631564:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984892416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (3294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383337.631581:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787383337.631840:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984892416:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787383337.633940:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383337.642503:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984892544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383337.642581:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383337.642980:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984892544 00000100:00100000:2.0:1787383337.642988:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984892544 00000100:00100000:2.0:1787383337.645750:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787383337.645786:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984892544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383337.645814:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383337.645905:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984892544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (3322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383337.645928:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787383337.650007:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984892544:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787383337.996000:0:14061:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:22:16 (1787383336) 00010000:00010000:0.0:1787383338.650973:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383339.066981:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383339.067030:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383339.067064:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383339.067099:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383339.067126:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383339.067162:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965923072 00000100:00100000:1.0:1787383339.067174:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965923072 00000100:00100000:1.0:1787383339.067254:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965923328 00000100:00100000:1.0:1787383339.067257:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965923328 00000100:00100000:1.0:1787383339.067271:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965922944 00000100:00100000:1.0:1787383339.067274:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965922944 00000100:00100000:1.0:1787383339.067286:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965923200 00000100:00100000:1.0:1787383339.067288:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965923200 00000100:00100000:1.0:1787383339.067303:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 263 00000100:00100000:1.0:1787383339.067311:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965923072:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383339.067570:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965923072:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 257us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383339.067579:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 263 00000100:00100000:1.0:1787383339.067600:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 264 00000100:00100000:1.0:1787383339.067606:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965923328:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383339.067632:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965923328:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 27us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383339.067638:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 264 00000100:00100000:1.0:1787383339.067648:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 265 00000100:00100000:1.0:1787383339.067654:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965922944:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383339.067696:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965922944:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 41us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383339.067702:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 265 00000100:00100000:1.0:1787383339.067713:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 266 00000100:00100000:1.0:1787383339.067719:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965923200:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383339.067742:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965923200:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383339.067748:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 266 00000100:00080000:1.0:1787383339.067814:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383339.067819:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383339.068684:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965922816 00000100:00100000:3.0:1787383339.068695:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965922816 00000100:00100000:3.0:1787383339.068753:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 376 00000100:00100000:3.0:1787383339.068762:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965922816:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383339.068871:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965922816:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 110us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383339.068879:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 376 00010000:00010000:3.0:1787383339.675182:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383339.867600:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383339.867741:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965923456 00000100:00100000:2.0:1787383339.867754:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965923456 00000100:00100000:2.0:1787383339.867892:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:2.0:1787383339.867903:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:11089:x1874206965923456:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383339.867932:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383339.867976:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026d2 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383339.868057:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e79d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383339.868074:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e79d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383339.868090:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e79d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383339.868150:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787383339.868154:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383339.868510:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e79d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383339.868543:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026d2 expref: 7 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383339.868589:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e79d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026d2 expref: 6 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383339.868599:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963610eea800) 00010000:00010000:2.0:1787383339.868602:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383339.868607:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f6400, rc 0) 00000100:00100000:2.0:1787383339.868693:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:11089:x1874206965923456:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 791us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383339.868702:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:2.0:1787383339.889331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383339.889559:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965923584 00000100:00100000:0.0:1787383339.889573:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965923584 00000100:00100000:0.0:1787383339.889644:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:0.0:1787383339.889657:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:11090:x1874206965923584:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383339.889682:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383339.889708:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e7a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026d9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.890090:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.890128:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.890218:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.890239:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.890248:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.890254:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.890334:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8600/0xc40acec91532e7b9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.890342:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8600/0xc40acec91532e7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.890349:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8600/0xc40acec91532e7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383339.891742:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787383339.891753:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383339.892076:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8600/0xc40acec91532e7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.892104:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.892130:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.892138:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.894238:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383339.894260:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.894274:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.894296:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963610eea800) 00010000:00010000:0.0:1787383339.894299:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383339.894305:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.894313:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.894336:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.894344:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.894351:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.894356:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383339.894378:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.895224:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.895243:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff963628fc9800) 00010000:00010000:0.0:1787383339.895246:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383339.895250:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.895257:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.895323:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e7a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026d9 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.895339:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8600/0xc40acec91532e7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026d9 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.895347:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff963628fc9000) 00010000:00010000:0.0:1787383339.895349:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383339.895352:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac8600, rc 0) 00000100:00100000:2.0:1787383339.896446:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:11090:x1874206965923584:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 6782us (7120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383339.896460:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:1.0:1787383339.907617:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383339.914563:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965923712 00000100:00100000:2.0:1787383339.914583:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965923712 00000100:00100000:0.0:1787383339.915676:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:0.0:1787383339.915697:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:11090:x1874206965923712:12345-192.168.203.2@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787383339.916361:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:11090:x1874206965923712:12345-192.168.203.2@tcp:900:lhsmtool_posix.0 Request processed in 667us (8753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383339.916373:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:1.0:1787383339.925142:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383339.931116:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965923968 00000100:00100000:0.0:1787383339.931223:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965923968 00000100:00100000:0.0:1787383339.931366:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:0.0:1787383339.931378:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+7:11090:x1874206965923968:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383339.931416:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383339.931444:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e7c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.931531:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7c7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.931547:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.931559:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.931576:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.931583:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.931591:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.931738:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8800/0xc40acec91532e7d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.931747:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8800/0xc40acec91532e7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.931755:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8800/0xc40acec91532e7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383339.934082:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1787383339.934366:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.934376:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7c7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.934392:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.934399:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383339.934405:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.934414:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7c7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.934433:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff963628fc9000) 00010000:00010000:0.0:1787383339.934436:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383339.934440:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.934446:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e7c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.934463:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.934469:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ce lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.934490:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.934495:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383339.934498:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.934504:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ce lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.934512:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff963628fc9800) 00010000:00010000:0.0:1787383339.934514:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383339.934517:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ce lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.934523:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e7ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.936154:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e7c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026e0 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.936184:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8800/0xc40acec91532e7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026e0 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383339.936194:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628fc9400) 00010000:00010000:0.0:1787383339.936197:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383339.936201:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac8800, rc 0) 00000100:00100000:0.0:1787383339.936278:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+9:11090:x1874206965923968:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 4901us (11148us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787383339.936312:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:2.0:1787383339.946757:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383339.946973:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965924096 00000100:00100000:1.0:1787383339.946983:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965924096 00000100:00100000:1.0:1787383339.947040:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:1.0:1787383339.947049:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+9:11090:x1874206965924096:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787383339.947182:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+9:11090:x1874206965924096:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 133us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383339.947189:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:3.0:1787383339.952746:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383339.952857:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965924224 00000100:00100000:2.0:1787383339.952868:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965924224 00000100:00100000:2.0:1787383339.952924:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:2.0:1787383339.952936:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:11090:x1874206965924224:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1787383339.954052:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1076us 00000100:00100000:0.0:1787383339.978124:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:11090:x1874206965924224:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 25183us (25379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383339.978137:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:3.0:1787383340.197481:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383340.197523:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984892672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383340.197735:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383340.197824:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984892672 00000100:00100000:1.0:1787383340.197835:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984892672 00000100:00100000:1.0:1787383340.197915:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787383340.197927:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984892672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383340.197980:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383340.198054:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984892672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383340.198061:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787383340.198134:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984892672:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1787383340.317700:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787383340.379666:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787383340.699384:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383341.212932:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984893184:0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.213032:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383341.213092:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984893696:0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.213122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383341.213139:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984894208:0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.213160:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383341.213186:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787383341.213192:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984892800:0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.213224:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383341.213246:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984893312:0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.213270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383341.213289:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984893824:0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.213311:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383341.213329:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984894336:0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.213351:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383341.214238:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984893056:0@lo:400:kworker.0 00000100:00100000:2.0:1787383341.214286:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383341.214320:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984893568:0@lo:400:kworker.0 00000100:00100000:2.0:1787383341.214368:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383341.214465:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984893312 00000100:00100000:3.0:1787383341.214475:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984893312 00000100:00100000:3.0:1787383341.214526:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984893056 00000100:00100000:2.0:1787383341.214657:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984894080:0@lo:400:kworker.0 00000100:00100000:2.0:1787383341.214682:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383341.214705:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787383341.214712:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984892928:0@lo:400:kworker.0 00000100:00100000:2.0:1787383341.214736:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383341.214752:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984893440:0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.215010:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984893184 00000100:00100000:0.0:1787383341.215023:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984893184 00000100:00100000:0.0:1787383341.215056:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984893568 00000100:00100000:0.0:1787383341.215060:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984893568 00000100:00100000:0.0:1787383341.215088:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984894080 00000100:00100000:0.0:1787383341.215091:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984894080 00000100:00100000:0.0:1787383341.215106:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984892928 00000100:00100000:0.0:1787383341.215109:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984892928 00000100:00100000:0.0:1787383341.215123:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787383341.215132:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984893184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383341.215226:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984893056 00000100:00100000:3.0:1787383341.215253:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787383341.215260:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984893312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383341.215356:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984893696 00000100:00100000:1.0:1787383341.215361:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984893696 00000100:00100000:1.0:1787383341.215399:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984894208 00000100:00100000:1.0:1787383341.215402:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984894208 00000100:00100000:1.0:1787383341.215415:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984893824 00000100:00100000:1.0:1787383341.215419:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984893824 00000100:00100000:1.0:1787383341.215430:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984894336 00000100:00100000:1.0:1787383341.215433:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984894336 00000100:00100000:1.0:1787383341.215448:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787383341.215455:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984893696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.215523:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984893184:12345-0@lo:400:kworker.0 Request processed in 390us (2490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383341.215541:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787383341.215570:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787383341.215576:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984893568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.215608:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984893568:12345-0@lo:400:kworker.0 Request processed in 32us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383341.215614:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787383341.215625:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787383341.215631:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984894080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.215658:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984894080:12345-0@lo:400:kworker.0 Request processed in 27us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383341.215664:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787383341.215675:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787383341.215681:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984892928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.215709:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984892928:12345-0@lo:400:kworker.0 Request processed in 29us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383341.215715:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787383341.215748:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984892800 00000100:00100000:0.0:1787383341.215752:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984892800 00000100:00100000:0.0:1787383341.215824:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1787383341.215831:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984892800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.215874:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984892800:12345-0@lo:400:kworker.0 Request processed in 44us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383341.215881:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1787383341.215921:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787383341.215928:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984894208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.215962:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984894208:12345-0@lo:400:kworker.0 Request processed in 34us (2801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383341.215968:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787383341.215983:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787383341.215989:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984893824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.216036:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984893824:12345-0@lo:400:kworker.0 Request processed in 47us (2724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383341.216043:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787383341.216055:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787383341.216061:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984894336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.216089:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984894336:12345-0@lo:400:kworker.0 Request processed in 28us (2737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383341.216094:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787383341.216167:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984892800:0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.216186:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984893824:0@lo:400:kworker.0 00010000:00080000:0.0:1787383341.216202:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447c700 x1874206984894336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383341.216220:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984894336:0@lo:400:kworker.0 00000100:00100000:0.0:1787383341.216236:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984893184:0@lo:400:kworker.0 00010000:00080000:0.0:1787383341.216249:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447f800 x1874206984894208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383341.216257:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984894208:0@lo:400:kworker.0 00000100:00100000:2.0:1787383341.217438:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383341.217492:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984893952:0@lo:400:kworker.0 00000100:00100000:2.0:1787383341.217720:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787383341.217793:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d918000 x1874206984893568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383341.217816:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984893568:0@lo:400:kworker.0 00010000:00080000:2.0:1787383341.217847:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447ed80 x1874206984894080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383341.217855:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984894080:0@lo:400:kworker.0 00000100:00100000:2.0:1787383341.217886:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984892928:0@lo:400:kworker.0 00000100:00100000:2.0:1787383341.217917:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984893440 00000100:00100000:2.0:1787383341.217923:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984893440 00000100:00100000:2.0:1787383341.217973:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984893952 00000100:00100000:2.0:1787383341.217977:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984893952 00000100:00100000:2.0:1787383341.217994:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787383341.218002:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984893440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383341.218061:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984893440:12345-0@lo:400:kworker.0 Request processed in 58us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383341.218081:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787383341.218098:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787383341.218105:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984893952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383341.218137:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984893952:12345-0@lo:400:kworker.0 Request processed in 32us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383341.218143:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787383341.219066:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984893312:12345-0@lo:400:kworker.0 Request processed in 3801us (5789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383341.219077:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787383341.219116:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787383341.219125:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984893056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383341.219167:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984893056:12345-0@lo:400:kworker.0 Request processed in 44us (4880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383341.219173:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787383341.219286:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984893312:0@lo:400:kworker.0 00000100:00100000:2.0:1787383341.219475:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984893440:0@lo:400:kworker.0 00000100:00100000:2.0:1787383341.219488:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984893952:0@lo:400:kworker.0 00000100:00100000:2.0:1787383341.219500:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984893056:0@lo:400:kworker.0 00000100:00100000:1.0:1787383341.221088:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984893696:12345-0@lo:400:kworker.0 Request processed in 5622us (7954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383341.221104:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1787383341.221149:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383341.221156:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383341.221160:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383341.221163:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383341.221266:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984893696:0@lo:400:kworker.0 00010000:00010000:3.0:1787383341.723234:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383341.724058:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984894464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383341.724150:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383341.724245:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984894464 00000100:00100000:3.0:1787383341.724265:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984894464 00000100:00100000:3.0:1787383341.724323:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787383341.724333:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984894464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383341.724370:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383341.724422:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984894464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383341.724431:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:3.0:1787383341.724483:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963608ccce00 x1874206984894464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383341.724503:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984894464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383341.724619:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383341.724628:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984894592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383341.724655:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383341.724713:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984894592 00000100:00100000:2.0:1787383341.724718:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984894592 00000100:00100000:2.0:1787383341.724750:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787383341.724757:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984894592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383341.724789:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383341.724827:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984894592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383341.724842:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:3.0:1787383341.725216:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963608ccce00 x1874206984894592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383341.725231:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984894592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383342.235022:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984894720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383342.235114:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383342.235220:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984894720 00000100:00100000:1.0:1787383342.235240:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984894720 00000100:00100000:1.0:1787383342.235314:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787383342.235339:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984894720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383342.235845:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787383342.235914:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984894720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 578us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383342.235927:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787383342.235990:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984894720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383342.747045:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984894848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383342.747129:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383342.747214:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984894848 00000100:00100000:2.0:1787383342.747221:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984894848 00000100:00100000:2.0:1787383342.747266:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787383342.747276:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984894848:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383342.747299:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984894976:0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787383342.747305:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787383342.747359:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984894848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383342.747367:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787383342.747413:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984894848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383342.747499:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383342.747843:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383342.750855:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984894976 00000100:00100000:2.0:1787383342.750870:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984894976 00000100:00100000:1.0:1787383342.756916:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787383342.756931:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984894976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383342.756961:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383342.757093:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984894976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 165us (9594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383342.757102:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787383342.758867:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984894976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383342.872001:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383342.872085:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965924352 00000100:00100000:2.0:1787383342.872094:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965924352 00000100:00100000:2.0:1787383342.872169:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:2.0:1787383342.872178:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+9:11132:x1874206965924352:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1787383342.872197:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383342.872215:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532e7e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026e7 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872283:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532e7ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872297:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532e7ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872309:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532e7ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787383342.872463:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787383342.872503:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532e7f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872511:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532e7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872519:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532e7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872570:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532e7ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872577:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532e7ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872582:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532e7ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872588:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383342.872591:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532e7ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872598:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532e7ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872610:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963610eea800) 00010000:00010000:2.0:1787383342.872613:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383342.872617:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532e7ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872622:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532e7ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872633:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532e7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872639:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532e7f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872644:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532e7f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872656:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383342.872659:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532e7f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872665:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532e7f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872672:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9635032cde00) 00010000:00010000:2.0:1787383342.872675:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383342.872677:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532e7f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872683:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532e7f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872713:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532e7e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026e7 expref: 10 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872724:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963610eea800) 00010000:00010000:2.0:1787383342.872726:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383342.872730:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532e7e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026e7 expref: 10 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383342.872739:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7200, rc 0) 00000100:00100000:2.0:1787383342.872818:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+9:11132:x1874206965924352:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 640us (822us total) trans 0 rc 301/301 00000100:00100000:2.0:1787383342.872835:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:2.0:1787383342.882305:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383342.888296:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965924608 00000100:00100000:0.0:1787383342.888310:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965924608 00000100:00100000:0.0:1787383342.888495:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:0.0:1787383342.888505:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+9:11132:x1874206965924608:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:0.0:1787383342.888556:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383342.888583:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e79d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026d2 expref: 9 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.888600:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963610eea800) 00010000:00010000:0.0:1787383342.888611:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383342.888670:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e7f8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.888683:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e7f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.888700:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e7f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.888713:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532e7ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.888721:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532e7ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.888727:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532e7ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.890443:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532e806 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.890461:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532e806 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.890472:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532e806 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383342.890487:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ee06f50 reply state 000000004cbf2dac transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532e806 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.890499:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532e806 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.890505:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:0.0:1787383342.890508:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383342.890511:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787383342.890516:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787383342.890524:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e7f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.890538:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e7f8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.890544:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e7f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.890551:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac9200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383342.890555:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e7f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.890562:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e7f8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.890572:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628fc9800) 00010000:00010000:0.0:1787383342.890575:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383342.890579:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e7f8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.890585:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e7f8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383342.890599:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ee06f50 reply state 000000004cbf2dac transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532e7ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.890607:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532e7ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.890613:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff963628fc9600) 00010000:00010000:0.0:1787383342.890615:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383342.890617:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787383342.890717:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+10:11132:x1874206965924608:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 2211us (8416us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787383342.890732:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:3.0:1787383342.954170:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383342.954331:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965924736 00000100:00100000:0.0:1787383342.954345:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965924736 00000100:00100000:0.0:1787383342.954489:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:0.0:1787383342.954503:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+10:11140:x1874206965924736:12345-192.168.203.2@tcp:101:lctl.0 00010000:00010000:0.0:1787383342.954536:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383342.954567:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e80d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026ee expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.954652:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e814 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.954668:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.954681:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383342.954739:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787383342.954744:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383342.954857:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e814 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.954892:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e80d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026ee expref: 12 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.954918:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e814 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026ee expref: 11 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383342.954951:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628fc9800) 00010000:00010000:0.0:1787383342.954955:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383342.954959:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac8200, rc 0) 00000100:00100000:3.0:1787383342.955364:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+11:11140:x1874206965924736:12345-192.168.203.2@tcp:101:lctl.0 Request processed in 860us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383342.955374:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:3.0:1787383343.024681:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.025065:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965924864 00000100:00100000:0.0:1787383343.025080:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965924864 00000100:00100000:0.0:1787383343.025179:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:0.0:1787383343.025192:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+11:11146:x1874206965924864:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1787383343.025219:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383343.025247:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e81b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026f5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025331:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e822 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025348:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025363:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025375:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532e829 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025382:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532e829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025389:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532e829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025506:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9800/0xc40acec91532e830 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025528:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9800/0xc40acec91532e830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025537:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9800/0xc40acec91532e830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383343.025582:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787383343.025586:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383343.025634:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9800/0xc40acec91532e830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025648:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025656:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e822 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025663:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025671:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac9600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383343.025676:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025686:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e822 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025701:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628fc9800) 00010000:00010000:0.0:1787383343.025710:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383343.025717:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025723:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9600/0xc40acec91532e822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025740:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532e829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025747:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532e829 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025753:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532e829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.025759:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383343.025761:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532e829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.026274:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532e829 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.026284:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff963628fc9600) 00010000:00010000:0.0:1787383343.026287:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383343.026291:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532e829 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.026297:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532e829 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.026331:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9200/0xc40acec91532e81b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026f5 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.026362:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9800/0xc40acec91532e830 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026f5 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.026371:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:0.0:1787383343.026373:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787383343.026376:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9800, rc 0) 00000100:00100000:3.0:1787383343.026735:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+12:11146:x1874206965924864:12345-192.168.203.2@tcp:101:bash.0 Request processed in 1542us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383343.026745:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:1.0:1787383343.034138:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.034275:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965925120 00000100:00100000:0.0:1787383343.034288:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965925120 00000100:00100000:0.0:1787383343.034361:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:0.0:1787383343.034373:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+12:11146:x1874206965925120:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1787383343.034399:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383343.034428:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e837 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34026fc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.034600:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532e83e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.034616:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532e83e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.034629:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532e83e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.039976:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e845 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.040000:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e845 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.040032:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e845 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787383343.040950:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787383343.041128:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532e84c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.041139:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532e84c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.041147:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532e84c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.041182:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532e83e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.041190:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532e83e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.041197:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532e83e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.041203:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383343.041208:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532e83e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.041215:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532e83e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.041229:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:0.0:1787383343.041232:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383343.041244:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532e83e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.041251:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532e83e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383343.041263:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000168ce8cc reply state 0000000037c3080d transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e845 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.041273:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e845 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.041279:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff963628fc9100) 00010000:00010000:0.0:1787383343.041281:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383343.041283:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787383343.041321:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532e837 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026fc expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.041336:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532e84c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026fc expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.041344:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383343.041346:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383343.041348:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16a00, rc 0) 00000100:00100000:0.0:1787383343.041423:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+15:11146:x1874206965925120:12345-192.168.203.2@tcp:101:bash.0 Request processed in 7052us (7298us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787383343.041432:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:0.0:1787383343.051037:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383343.053148:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965925248 00000100:00100000:1.0:1787383343.053160:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965925248 00000100:00100000:1.0:1787383343.053216:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:1.0:1787383343.053224:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1874206965925248:12345-192.168.203.2@tcp:8:bash.0 00010000:00080000:1.0:1787383343.053255:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp t0 exp 0000000000000000 cur 376 last 0 00000020:00000080:1.0:1787383343.053282:0:8435:0:(genops.c:1406:class_connect()) connect: client a75c5b6d-4c9e-4295-9df6-097efce92717, cookie 0xc40acec91532e85a 00002000:00100000:1.0:1787383343.053293:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a75c5b6d-4c9e-4295-9df6-097efce92717/ffff96363f98e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787383343.053309:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787383343.053378:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787383343.053406:0:8435:0:(import.c:65:import_set_state_nolock()) ffff96363f98c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383343.053474:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2400:x1874206965925248:12345-192.168.203.2@tcp:8:bash.0 Request processed in 249us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383343.053482:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:3.0:1787383343.058383:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.058494:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965925376 00000100:00100000:0.0:1787383343.058508:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965925376 00000100:00100000:0.0:1787383343.058617:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:0.0:1787383343.058628:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:0:x1874206965925376:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1787383343.058644:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383343.058667:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005eeb0b68/0xc40acec91532e861 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402703 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383343.058691:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383343.058720:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1787383343.058725:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383343.058733:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005eeb0b68/0xc40acec91532e861 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402703 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.058753:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005eeb0b68/0xc40acec91532e861 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402703 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.058809:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16600, rc 0) 00000100:00100000:0.0:1787383343.058884:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:0:x1874206965925376:12345-192.168.203.2@tcp:101:bash.0 Request processed in 257us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383343.058892:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00080000:3.0:1787383343.059253:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383343.061837:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383343.061927:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965925504 00000100:00100000:1.0:1787383343.061937:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965925504 00000100:00100000:1.0:1787383343.061979:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:1.0:1787383343.061988:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:11146:x1874206965925504:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1787383343.062003:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383343.062022:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340270a expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.062050:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005eeb0b68/0xc40acec91532e861 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402703 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.062059:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383343.062063:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383343.062068:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.062102:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005eeb0b68/0xc40acec91532e861 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402703 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.062116:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005eeb0b68/0xc40acec91532e861 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402703 expref: 8 pid: 8436 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383343.062129:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1874206984895104:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383343.062228:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608cb96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383343.065409:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383343.065533:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965925632 00000100:00100000:1.0:1787383343.065534:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1874206984895104:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383343.065546:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965925632 00010000:00010000:1.0:1787383343.065574:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.065603:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005eeb0b68/0xc40acec91532e861 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402703 expref: 9 pid: 8436 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.065616:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1400, rc 0) 00000100:00100000:3.0:1787383343.065659:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:3.0:1787383343.065672:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965925632:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383343.065690:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383343.065716:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005eeb0b68/0xc40acec91532e861 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402703 expref: 9 pid: 8436 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.065732:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005eeb0b68/0xc40acec91532e861 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402703 expref: 9 pid: 8436 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.065809:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005eeb0b68/0xc40acec91532e861 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402703 expref: 9 pid: 8436 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383343.065866:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+8:11146:x1874206965925504:12345-192.168.203.2@tcp:101:bash.0 Request processed in 3876us (4045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383343.065876:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 30 00010000:00010000:3.0:1787383343.065909:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383343.065917:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383343.065929:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.065947:0:7461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.066014:0:7461:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383343.066032:0:7461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503025f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7461:1874206984895232:192.168.203.2@tcp:105: 00000100:00100000:3.0:1787383343.066126:0:7461:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383343.080208:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383343.080369:0:7461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503025f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7461:1874206984895232:192.168.203.2@tcp:105: 00010000:00010000:3.0:1787383343.080404:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383343.080491:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965925632:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 14820us (15093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383343.080503:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:0.0:1787383343.081132:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965925888 00000100:00100000:0.0:1787383343.081143:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965925888 00000100:00100000:0.0:1787383343.081197:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:0.0:1787383343.081207:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+15:11146:x1874206965925888:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:0.0:1787383343.081487:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+16:11146:x1874206965925888:12345-192.168.203.2@tcp:35:bash.0 Request processed in 279us (1286us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787383343.081495:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:2.0:1787383343.204939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383343.205129:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965926144 00000100:00100000:3.0:1787383343.205144:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965926144 00000100:00100000:3.0:1787383343.205229:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:3.0:1787383343.205241:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+16:11156:x1874206965926144:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383343.205459:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383343.205491:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e86f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402711 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383343.205703:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787383343.205888:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e86f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402711 expref: 18 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.205995:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628fc9800) 00010000:00010000:3.0:1787383343.205999:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787383343.206024:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e86f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402711 expref: 18 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.206045:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601654e00, rc 0) 00000100:00100000:3.0:1787383343.206132:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+17:11156:x1874206965926144:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 892us (1209us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1787383343.206142:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:3.0:1787383343.217922:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.218145:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965926400 00000100:00100000:0.0:1787383343.218158:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965926400 00000100:00100000:0.0:1787383343.218384:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:0.0:1787383343.218395:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+17:11156:x1874206965926400:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383343.218813:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+18:11156:x1874206965926400:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 419us (905us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787383343.218821:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:2.0:1787383343.319958:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383343.322838:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965926528 00000100:00100000:3.0:1787383343.322860:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965926528 00000100:00100000:3.0:1787383343.322967:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:3.0:1787383343.322981:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+18:11162:x1874206965926528:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383343.323016:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383343.323044:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e87d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402718 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.323140:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e884 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.323160:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.323174:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383343.323233:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787383343.323237:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383343.323262:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.323319:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e87d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402718 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.323345:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e884 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402718 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.323353:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:3.0:1787383343.323355:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383343.323359:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655600, rc 0) 00000100:00100000:3.0:1787383343.323442:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+19:11162:x1874206965926528:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 464us (3497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383343.323449:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:2.0:1787383343.329399:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.329510:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965926784 00000100:00100000:0.0:1787383343.329534:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965926784 00000100:00100000:0.0:1787383343.329610:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:0.0:1787383343.329624:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+19:11162:x1874206965926784:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383343.329653:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383343.329682:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532e88b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340271f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.330051:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532e892 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.330070:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532e892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.330084:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532e892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383343.330098:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787383343.330236:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532e88b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340271f expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.330258:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532e892 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340271f expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.330275:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383343.330278:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383343.330283:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17000, rc 0) 00000100:00100000:0.0:1787383343.330411:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+21:11162:x1874206965926784:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 790us (1027us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787383343.330420:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:0.0:1787383343.339552:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.339603:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383343.339683:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965927168 00000100:00100000:1.0:1787383343.339695:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965927168 00000100:00100000:3.0:1787383343.339739:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965927040 00000100:00100000:3.0:1787383343.339746:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965927040 00000100:00100000:3.0:1787383343.339848:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:3.0:1787383343.339860:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+22:11162:x1874206965927040:12345-192.168.203.2@tcp:101:lfs.0 00000100:00100000:1.0:1787383343.339887:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00010000:00010000:3.0:1787383343.339889:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787383343.339900:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+22:2402:x1874206965927168:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383343.339918:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402726 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.339919:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383343.340011:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532e892 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340271f expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.340032:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:1.0:1787383343.340039:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383343.340054:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532e8a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.340071:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532e8a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.340084:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532e8a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383343.340110:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+22:2402:x1874206965927168:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 213us (504us total) trans 0 rc 0/0 00000004:00200000:3.0:1787383343.340117:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:1.0:1787383343.340122:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00010000:00010000:3.0:1787383343.340526:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402726 expref: 23 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.340550:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532e8a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402726 expref: 22 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.340560:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:3.0:1787383343.340563:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787383343.340566:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655400, rc 0) 00000100:00100000:3.0:1787383343.340602:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+22:11162:x1874206965927040:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 745us (1064us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787383343.340609:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:2.0:1787383343.346540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.346715:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965927296 00000100:00100000:0.0:1787383343.346729:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965927296 00000100:00100000:0.0:1787383343.346857:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:0.0:1787383343.346869:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965927296:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:0.0:1787383343.346932:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.346957:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.346967:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383343.346971:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383343.346976:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.347026:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.347209:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 7 pid: 8435 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383343.347228:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874206984895360:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383343.347345:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618141600 going to sleep for 11 seconds 00000100:00100000:2.0:1787383343.349848:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874206984895360:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383343.349892:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383343.356994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.358949:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965927424 00000100:00100000:0.0:1787383343.358971:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965927424 00002000:00100000:0.0:1787383343.359042:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff963503fdb100 x1874206965927424/t0(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:129/0 lens 504/0 e 0 to 0 dl 1787383354 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787383343.359056:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503fdb100 with x1874206965927424 ext(0->12) 00010000:00010000:0.0:1787383343.359067:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 8 pid: 8435 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.359089:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 8 pid: 8435 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383343.359099:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff963503fdb100 00000100:00100000:0.0:1787383343.359184:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:0.0:1787383343.359196:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2401:x1874206965927424:12345-192.168.203.2@tcp:4:lfs.0 00000001:00100000:1.0:1787383343.364386:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000100:00100000:0.0:1787383343.366754:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2401:x1874206965927424:12345-192.168.203.2@tcp:4:lfs.0 Request processed in 7551us (9760us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787383343.366897:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00002000:00100000:0.0:1787383343.366910:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff963503fdb100 x1874206965927424/t4294967300(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:129/0 lens 504/448 e 0 to 0 dl 1787383354 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787383343.366938:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503fdb100 with x1874206965927424 ext(0->12) 00010000:00010000:0.0:1787383343.366959:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 9 pid: 8435 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.366978:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 9 pid: 8435 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383343.366987:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff963503fdb100 00000100:00100000:1.0:1787383343.374819:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.375192:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965927552 00000100:00100000:0.0:1787383343.375204:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965927552 00010000:00010000:0.0:1787383343.375256:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 9 pid: 8435 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383343.375311:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:0.0:1787383343.375321:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2404:x1874206965927552:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383343.375340:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787383343.375363:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787383343.375367:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787383343 00002000:00010000:0.0:1787383343.375370:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787383343 00002000:00010000:0.0:1787383343.375372:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787383343 00002000:00010000:0.0:1787383343.375374:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787383343.375382:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 9 pid: 8435 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.375399:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 9 pid: 8435 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.375448:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004387c52e/0xc40acec91532e868 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340270a expref: 9 pid: 8435 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.375470:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383343.375475:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383343.375482:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.375493:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.375668:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383343.375738:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383343.375758:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383343.375843:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383343.375856:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383343.375867:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383343.375897:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383343.375903:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383343.375913:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383343.375936:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383343.375943:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051972375/0xc40acec91532e8b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383343.376042:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2404:x1874206965927552:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 717us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383343.376053:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:2.0:1787383343.376107:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965927296:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 29236us (29588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383343.376118:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:0.0:1787383343.386205:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383343.386289:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965927808 00000100:00100000:1.0:1787383343.386302:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965927808 00000100:00100000:1.0:1787383343.386374:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:1.0:1787383343.386385:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+22:11162:x1874206965927808:12345-192.168.203.2@tcp:35:lfs.0 00000004:00010000:1.0:1787383343.386466:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532e8a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402726 expref: 22 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383343.387727:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1787383343.388079:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1787383343.388201:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787383343.388581:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1787383343.388635:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.388662:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532e84c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026fc expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.388673:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.388725:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532e84c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026fc expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.388744:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532e84c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026fc expref: 26 pid: 6520 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383343.389131:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874206984895488:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383343.389462:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608cb96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383343.396269:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383343.396379:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965927936 00000100:00100000:3.0:1787383343.396391:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965927936 00010000:00010000:3.0:1787383343.396444:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532e84c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026fc expref: 27 pid: 6520 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383343.396496:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:3.0:1787383343.396508:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+27:2401:x1874206965927936:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383343.396528:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383343.396537:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532e84c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026fc expref: 27 pid: 6520 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.396554:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532e84c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026fc expref: 27 pid: 6520 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.396607:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:3.0:1787383343.396614:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.396625:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.396633:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.396658:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383343.396734:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+27:2401:x1874206965927936:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 227us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383343.396743:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 54 00010000:00010000:1.0:1787383343.397343:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532e84c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026fc expref: 26 pid: 6520 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383343.397367:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874206984895488:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383343.397397:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.397423:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.397431:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383343.397579:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1787383343.397728:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1787383343.398111:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874206984895616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787383343.398180:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383343.398264:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608cb60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383343.408695:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984895616 00000100:00100000:0.0:1787383343.408717:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984895616 00000100:00100000:0.0:1787383343.408862:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787383343.408874:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874206984895616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787383343.409051:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874206984895616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 179us (10870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383343.409061:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787383343.409131:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874206984895616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787383343.409387:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1787383343.409506:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874206984895744:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787383343.409557:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383343.409584:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618141f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383343.409604:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984895744 00000100:00100000:0.0:1787383343.409609:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984895744 00000100:00100000:0.0:1787383343.409636:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787383343.409642:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874206984895744:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787383343.409753:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6524:x1874206984895744:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 110us (196us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787383343.409760:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787383343.409858:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874206984895744:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787383343.409908:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1787383343.409948:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.409962:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.409972:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.409979:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383343.409985:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.409994:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.410014:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383343.410025:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787383343.410031:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.410039:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532e8bc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787383343.410168:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787383343.410251:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787383343.410265:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376438497958ns, next at 377438495321ns, rc = 0 00000001:00080000:0.0:1787383343.410271:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1787383343.410297:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383343.410300:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787383343.410308:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532e8a7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402726 expref: 30 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383343.410422:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+29:11162:x1874206965927808:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 24039us (24229us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1787383343.410432:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000020:00080000:0.0:1787383343.410437:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1787383343.411380:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383343.414474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.422639:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965928064 00000100:00100000:0.0:1787383343.422661:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965928064 00000100:00100000:0.0:1787383343.422755:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:0.0:1787383343.422791:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+29:11162:x1874206965928064:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383343.422836:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383343.422866:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532e8c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340272d expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.422943:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532e8c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340272d expref: 30 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.422983:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532e8c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340272d expref: 30 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.423008:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383343.423012:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787383343.423017:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17c00, rc 0) 00000100:00100000:0.0:1787383343.423116:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+30:11162:x1874206965928064:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 350us (8657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383343.423124:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:2.0:1787383343.426216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.426531:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965928320 00000100:00100000:0.0:1787383343.426545:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965928320 00000100:00100000:0.0:1787383343.426621:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:0.0:1787383343.426632:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628e5b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+30:11162:x1874206965928320:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1787383343.427432:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628e5b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+31:11162:x1874206965928320:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 794us (1222us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787383343.427443:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000040:00080000:1.0:1787383343.451421:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787383343.509927:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.510046:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965928576 00000100:00100000:0.0:1787383343.510061:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965928576 00000100:00100000:0.0:1787383343.510143:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:0.0:1787383343.510156:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+31:11172:x1874206965928576:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383343.510193:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383343.510223:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532e8ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402734 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383343.510357:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787383343.510486:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532e8ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402734 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.510528:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628fc9800) 00010000:00010000:0.0:1787383343.510532:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383343.510539:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532e8ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402734 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.510556:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17800, rc 0) 00000100:00100000:0.0:1787383343.510729:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+32:11172:x1874206965928576:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 575us (816us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1787383343.510738:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:1.0:1787383343.518898:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383343.519231:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965928704 00000100:00100000:3.0:1787383343.519243:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965928704 00000100:00100000:3.0:1787383343.519312:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:3.0:1787383343.519324:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+32:11172:x1874206965928704:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:3.0:1787383343.519429:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.519451:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.519464:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.519478:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.519504:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.519511:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.519619:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e8e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.519629:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.519636:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383343.519701:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.519716:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.519723:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.519730:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.519736:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383343.519741:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.519749:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520194:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:3.0:1787383343.520199:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383343.520205:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520213:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520233:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520237:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520241:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520245:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383343.520247:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520250:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520255:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff963628fc9100) 00010000:00010000:3.0:1787383343.520257:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383343.520259:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520263:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520281:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e8e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520285:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e8e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520290:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520292:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383343.520294:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e8e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520297:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e8e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520301:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:3.0:1787383343.520302:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383343.520304:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e8e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.520307:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e8e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383343.520426:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+32:11172:x1874206965928704:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 1100us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383343.520436:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:2.0:1787383343.525594:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.526038:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965928960 00000100:00100000:0.0:1787383343.526053:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965928960 00000100:00100000:0.0:1787383343.526131:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:0.0:1787383343.526143:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+32:11172:x1874206965928960:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383343.526511:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+33:11172:x1874206965928960:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 368us (930us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787383343.526521:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1787383343.614442:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383343.614716:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965929216 00000100:00100000:3.0:1787383343.614731:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965929216 00000100:00100000:3.0:1787383343.614854:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:3.0:1787383343.615042:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+33:11175:x1874206965929216:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383343.615077:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383343.615108:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e8ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340273b expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615212:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615231:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615246:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615260:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615268:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615275:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615422:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e902 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615431:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615439:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e902 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383343.615463:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787383343.615566:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615575:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615582:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615589:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383343.615595:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615603:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615618:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:3.0:1787383343.615621:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383343.615627:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615634:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e8f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615652:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615659:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615677:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615683:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383343.615686:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615693:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615702:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff963628fc9100) 00010000:00010000:3.0:1787383343.615704:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383343.615708:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615714:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e8fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615838:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e8ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340273b expref: 36 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615856:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e902 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340273b expref: 35 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383343.615864:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:3.0:1787383343.616203:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383343.616208:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601654600, rc 0) 00000100:00100000:3.0:1787383343.616302:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+35:11175:x1874206965929216:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1262us (1873us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787383343.622459:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:1.0:1787383343.629460:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.629685:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965929344 00000100:00100000:0.0:1787383343.629699:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965929344 00000100:00100000:0.0:1787383343.630652:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:0.0:1787383343.630674:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+35:11175:x1874206965929344:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:0.0:1787383343.631675:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532e910 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.631703:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532e910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383343.631741:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532e910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.632380:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532e910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.632393:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532e910 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.632401:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532e910 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.632407:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383343.632413:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532e910 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.632421:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532e910 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.632451:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:1.0:1787383343.632455:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383343.632462:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532e910 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383343.632469:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532e910 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383343.633921:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+35:11175:x1874206965929344:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 3238us (4460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383343.633938:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:2.0:1787383343.647339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383343.647451:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965929600 00000100:00100000:0.0:1787383343.647464:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965929600 00000100:00100000:0.0:1787383343.647548:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:0.0:1787383343.647563:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+35:11175:x1874206965929600:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383343.648512:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+36:11175:x1874206965929600:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 946us (1182us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787383343.648524:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00010000:00010000:3.0:1787383343.771853:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383344.190574:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383344.190631:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383344.190694:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383344.190814:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965929984 00000100:00100000:3.0:1787383344.190836:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965929984 00000100:00100000:0.0:1787383344.190847:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965929856 00000100:00100000:0.0:1787383344.190851:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965929856 00000100:00100000:1.0:1787383344.190911:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965929728 00000100:00100000:1.0:1787383344.190916:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965929728 00000100:00100000:3.0:1787383344.190930:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 273 00000100:00100000:3.0:1787383344.190942:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206965929984:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383344.190952:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 378 00000100:00100000:1.0:1787383344.190958:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2401:x1874206965929728:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383344.191050:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206965929984:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 110us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383344.191059:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 273 00000100:00100000:0.0:1787383344.192346:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 274 00000100:00100000:0.0:1787383344.192374:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965929856:12345-192.168.203.2@tcp:400:kworker.0 00000100:00080000:2.0:1787383344.195573:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383344.195597:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383344.195963:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2401:x1874206965929728:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 4987us (5387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383344.195984:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 378 00000100:00100000:1.0:1787383344.196182:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383344.196219:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965930112 00000100:00100000:1.0:1787383344.196229:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965930112 00000100:00100000:1.0:1787383344.196295:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 275 00000100:00100000:1.0:1787383344.196305:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965930112:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383344.196364:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965930112:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 61us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383344.196371:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 275 00000100:00080000:1.0:1787383344.198163:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383344.198287:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965929856:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 5919us (7582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383344.198309:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 274 00000100:00100000:2.0:1787383344.210738:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383344.211295:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965930368 00000100:00100000:0.0:1787383344.211309:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965930368 00000100:00100000:0.0:1787383344.211408:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:0.0:1787383344.211419:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+36:11208:x1874206965930368:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1787383344.211452:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383344.211480:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e917 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402742 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.211650:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532e91e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.211686:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532e91e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.211703:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532e91e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383344.211718:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00080000:1.0:1787383344.212012:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787383344.213476:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e917 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402742 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.213514:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532e91e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402742 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.213525:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383344.213529:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383344.213534:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16c00, rc 0) 00000100:00100000:0.0:1787383344.219032:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+38:11208:x1874206965930368:12345-192.168.203.2@tcp:101:cat.0 Request processed in 7584us (8279us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787383344.219049:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:3.0:1787383344.243454:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383344.248550:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965930496 00000100:00100000:1.0:1787383344.248574:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965930496 00000100:00100000:1.0:1787383344.248710:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:1.0:1787383344.248724:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+38:2402:x1874206965930496:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383344.248746:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383344.249662:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532e91e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402742 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.249691:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:1.0:1787383344.249697:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383344.250067:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+37:2402:x1874206965930496:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1345us (6627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383344.250079:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:2.0:1787383344.255739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383344.255918:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965930752 00000100:00100000:1.0:1787383344.255931:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965930752 00000100:00100000:1.0:1787383344.255998:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:1.0:1787383344.256024:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+37:11208:x1874206965930752:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1787383344.256337:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+38:11208:x1874206965930752:12345-192.168.203.2@tcp:35:cat.0 Request processed in 315us (610us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1787383344.256346:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:3.0:1787383344.373955:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383344.374252:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965931008 00000100:00100000:1.0:1787383344.374265:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965931008 00000100:00100000:1.0:1787383344.374344:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:1.0:1787383344.374356:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+38:11213:x1874206965931008:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:1.0:1787383344.374388:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383344.374409:0:10098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787383344.374446:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e884 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402718 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.374471:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:1.0:1787383344.374477:0:10098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383344.374495:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532e92c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402749 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.374633:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.374648:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e902 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340273b expref: 38 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.374656:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.374696:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e902 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340273b expref: 38 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.375580:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e902 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340273b expref: 38 pid: 10098 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383344.375613:0:10098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984895872:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383344.375752:0:10098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636012ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383344.387612:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383344.387931:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965931136 00000100:00100000:0.0:1787383344.387947:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965931136 00010000:00010000:0.0:1787383344.388008:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e902 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340273b expref: 39 pid: 10098 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383344.388059:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:0.0:1787383344.388071:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+39:2402:x1874206965931136:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383344.388090:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383344.388115:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e902 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340273b expref: 39 pid: 10098 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.388132:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e902 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340273b expref: 39 pid: 10098 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.388162:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383344.388168:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.388180:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.388191:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.388215:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383344.388284:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+39:2402:x1874206965931136:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 215us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383344.388294:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 55 00010000:00010000:1.0:1787383344.388462:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e902 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340273b expref: 38 pid: 10098 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383344.388494:0:10098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984895872:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383344.388529:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.388540:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.388546:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383344.388567:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787383344.388966:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532e92c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402749 expref: 39 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.388983:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402749 expref: 38 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.388991:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:1.0:1787383344.388994:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787383344.388997:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0e00, rc 0) 00000100:00100000:1.0:1787383344.389036:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+38:11213:x1874206965931008:12345-192.168.203.2@tcp:101:dd.0 Request processed in 14681us (15097us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787383344.389043:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:2.0:1787383344.396393:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383344.396501:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965931264 00000100:00100000:0.0:1787383344.396516:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965931264 00000100:00100000:0.0:1787383344.396593:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:0.0:1787383344.396604:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+38:11213:x1874206965931264:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:0.0:1787383344.396637:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383344.396666:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e941 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402750 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.396710:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532e948 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.396744:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532e948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.396804:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532e948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.396983:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e941 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402750 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.397005:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532e948 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402750 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.397014:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383344.397017:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787383344.397021:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16400, rc 0) 00000100:00100000:0.0:1787383344.397089:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+39:11213:x1874206965931264:12345-192.168.203.2@tcp:101:dd.0 Request processed in 487us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383344.397097:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:3.0:1787383344.403435:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383344.403533:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965931520 00000100:00100000:0.0:1787383344.403547:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965931520 00000100:00100000:0.0:1787383344.403623:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:0.0:1787383344.403636:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+39:11213:x1874206965931520:12345-192.168.203.2@tcp:36:dd.0 00010000:00010000:0.0:1787383344.404028:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e94f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.404050:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e94f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.404088:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e94f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787383344.404141:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1787383344.404168:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096c6643a reply state 00000000f2192c26 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e94f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.404184:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e94f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383344.404193:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383344.404195:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383344.404199:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383344.404324:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+42:11213:x1874206965931520:12345-192.168.203.2@tcp:36:dd.0 Request processed in 689us (902us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1787383344.404333:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00000020:00080000:0.0:1787383344.404340:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787383344.795026:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383344.835220:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383344.835371:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965931648 00000100:00100000:1.0:1787383344.835384:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965931648 00000100:00100000:1.0:1787383344.835473:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:1.0:1787383344.835485:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+42:11228:x1874206965931648:12345-192.168.203.2@tcp:101:stat.0 00010000:00010000:1.0:1787383344.835537:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383344.835565:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532e956 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402757 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.835668:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532e95d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.835685:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532e95d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.835698:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532e95d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.835726:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532e964 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.835734:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532e964 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.835740:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532e964 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.835917:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e96b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.835929:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402749 expref: 43 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.835938:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e96b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.835982:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402749 expref: 43 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.836006:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402749 expref: 43 pid: 10098 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383344.836023:0:10098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984896000:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383344.836155:0:10098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636012ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383344.840690:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383344.840857:0:10098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984896000:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383344.840893:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e96b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383344.841383:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965931904 00000100:00100000:0.0:1787383344.841392:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965931904 00000100:00100000:0.0:1787383344.841520:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:0.0:1787383344.841531:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+44:6171:x1874206965931904:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787383344.842453:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+45:6171:x1874206965931904:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 919us (1773us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787383344.842464:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:3.0:1787383344.850262:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383344.851010:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965932032 00000100:00100000:2.0:1787383344.851024:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965932032 00010000:00010000:2.0:1787383344.851082:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402749 expref: 45 pid: 10098 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383344.851130:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:2.0:1787383344.851141:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503171c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+45:2401:x1874206965932032:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383344.851162:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383344.851170:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402749 expref: 45 pid: 10098 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383344.851187:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402749 expref: 45 pid: 10098 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383344.851241:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e933 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402749 expref: 45 pid: 10098 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383344.851262:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:2.0:1787383344.851267:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e96b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383344.851279:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e96b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383344.851288:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e96b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383344.852964:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383344.853073:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503171c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+44:2401:x1874206965932032:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1926us (2819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383344.853086:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 56 00010000:00010000:1.0:1787383344.859720:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e96b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.859743:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e96b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383344.859865:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787383344.859871:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787383344.860239:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e96b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860261:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e96b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860273:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532e95d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860281:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532e95d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860289:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532e95d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860296:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383344.860318:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532e95d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860327:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532e95d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860346:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:1.0:1787383344.860349:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383344.860354:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532e95d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860361:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532e95d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860385:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532e964 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860391:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532e964 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860397:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532e964 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860402:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383344.860405:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532e964 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860410:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532e964 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860418:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff963628fc9100) 00010000:00010000:1.0:1787383344.860421:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383344.860431:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532e964 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860437:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532e964 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860488:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532e956 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402757 expref: 44 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860505:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e96b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402757 expref: 43 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383344.860522:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:1.0:1787383344.860525:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383344.860528:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1000, rc 0) 00000100:00100000:1.0:1787383344.860633:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+43:11228:x1874206965931648:12345-192.168.203.2@tcp:101:stat.0 Request processed in 25148us (25428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383344.860643:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:3.0:1787383345.009609:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383345.009808:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965932288 00000100:00100000:2.0:1787383345.009831:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965932288 00000100:00100000:2.0:1787383345.009926:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:2.0:1787383345.009939:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+43:11234:x1874206965932288:12345-192.168.203.2@tcp:36:truncate.0 00010000:00010000:2.0:1787383345.010019:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383345.010063:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e96b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402757 expref: 43 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.010088:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:2.0:1787383345.010093:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383345.010351:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e972 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.010370:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e972 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.010382:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e972 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383345.010426:0:9499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1787383345.010447:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000025774f2b reply state 00000000534d55cd transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e972 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.010461:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e972 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.010468:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:2.0:1787383345.010471:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787383345.010473:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383345.010605:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+45:11234:x1874206965932288:12345-192.168.203.2@tcp:36:truncate.0 Request processed in 668us (1011us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787383345.010613:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000020:00080000:2.0:1787383345.010618:0:9499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:3.0:1787383345.030347:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000004:00080000:3.0:1787383345.030390:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787383345.030424:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9636181416c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787383345.030429:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9635032c8000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff963618141c00 00000020:00080000:3.0:1787383345.030433:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9635032c8500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96363da47400 00010000:00010000:0.0:1787383345.030557:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532e7ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.030570:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532e7ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.030594:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532e7ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.030600:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac9400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383345.030604:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532e7ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031081:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532e7ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031102:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff963628fc9600) 00010000:00010000:0.0:1787383345.031105:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383345.031110:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532e7ff lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031116:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532e7ff lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031137:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532e806 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031144:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532e806 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031149:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532e806 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031154:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383345.031157:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532e806 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031172:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532e806 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031179:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:0.0:1787383345.031181:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383345.031184:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532e806 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031189:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532e806 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031202:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e845 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031207:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e845 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031212:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e845 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031216:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383345.031219:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e845 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031224:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e845 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031230:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff963628fc9100) 00010000:00010000:0.0:1787383345.031232:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383345.031235:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e845 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031244:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e845 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031258:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e94f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031264:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e94f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031269:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e94f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031275:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383345.031278:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e94f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031283:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e94f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031291:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383345.031293:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383345.031296:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e94f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031302:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e94f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031312:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e972 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031318:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e972 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031330:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e972 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031336:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383345.031339:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e972 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031345:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e972 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031352:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383345.031354:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383345.031357:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e972 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.031363:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e972 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787383345.031649:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787383345.032156:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787383345.032213:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383345.032232:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984896128:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787383345.032297:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383345.032407:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984896128 00000100:00100000:1.0:1787383345.032415:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984896128 00000100:00100000:1.0:1787383345.032480:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383345.032490:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1874206984896128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787383345.032580:0:8914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1787383345.032611:0:8914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a894e2f, atime: 0x6a894e2f, ctime: 0x6a894e2f, blocks: 0x8 00010000:00010000:1.0:1787383345.033009:0:8914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532e979 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.033025:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1787383345.033029:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383345.033043:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532e979 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.033060:0:8914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532e979 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.033069:0:8914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532e979 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.033076:0:8914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532e979 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.033096:0:8914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787383345.033226:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1874206984896128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 737us (927us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787383345.033234:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1787383345.033258:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383345.033264:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532e979 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.033272:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383345.033276:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532e979 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.033286:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532e979 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.033312:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532e979 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.033320:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532e979 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.033337:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383345.033339:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383345.033340:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787383345.033372:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9636084b6d80/2, rc 0, transno 4294967302 00000100:00100000:1.0:1787383345.033378:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984896128:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1787383345.033607:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787383345.285648:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383345.286230:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965932416 00000100:00100000:2.0:1787383345.286240:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965932416 00000100:00100000:2.0:1787383345.286305:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:2.0:1787383345.286315:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+11:11248:x1874206965932416:12345-192.168.203.2@tcp:101:stat.0 00010000:00010000:2.0:1787383345.286336:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383345.286363:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e980 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340275e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.286422:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e987 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.286435:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e987 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.286446:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e987 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.286470:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532e98e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.286477:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532e98e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.286483:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532e98e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.288417:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e995 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.288438:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.288449:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383345.288498:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787383345.288502:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383345.288848:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.288861:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.288870:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e987 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.288876:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e987 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.288883:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e987 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.288888:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383345.288892:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e987 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.288965:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e987 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.288978:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:3.0:1787383345.288994:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383345.288999:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e987 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.289005:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532e987 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.289024:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532e98e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.289029:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532e98e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.289034:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532e98e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.289038:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383345.289040:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532e98e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.289045:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532e98e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.289052:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9635032cde00) 00010000:00010000:3.0:1787383345.289054:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383345.289057:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532e98e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.289062:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532e98e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.289102:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532e980 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340275e expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.289126:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340275e expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.289133:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:3.0:1787383345.289135:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383345.289138:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655c00, rc 0) 00000100:00100000:3.0:1787383345.290702:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+12:11248:x1874206965932416:12345-192.168.203.2@tcp:101:stat.0 Request processed in 4381us (5055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383345.290713:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:2.0:1787383345.307232:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984896256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383345.307423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383345.307742:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984896256 00000100:00100000:1.0:1787383345.307750:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984896256 00000100:00100000:1.0:1787383345.307892:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787383345.308390:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984896256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383345.308432:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383345.308696:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984896256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 311us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383345.309938:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984896256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787383345.314071:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787383345.457919:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383345.458076:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965932672 00000100:00100000:3.0:1787383345.458090:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965932672 00000100:00100000:3.0:1787383345.458269:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:3.0:1787383345.458281:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+12:11258:x1874206965932672:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383345.458308:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383345.458334:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e99c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402765 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383345.458629:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787383345.459216:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e99c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402765 expref: 14 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.459236:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628fc9800) 00010000:00010000:3.0:1787383345.459240:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787383345.459245:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e99c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402765 expref: 14 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.459288:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655000, rc 0) 00000100:00100000:3.0:1787383345.459373:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+13:11258:x1874206965932672:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1094us (1468us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1787383345.459382:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:1.0:1787383345.462631:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383345.462936:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965932928 00000100:00100000:2.0:1787383345.462949:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965932928 00000100:00100000:2.0:1787383345.463079:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:2.0:1787383345.463092:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+13:11258:x1874206965932928:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1787383345.463437:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+14:11258:x1874206965932928:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 346us (819us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1787383345.463467:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:2.0:1787383345.519805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383345.519886:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965933184 00000100:00100000:0.0:1787383345.519900:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965933184 00000100:00100000:0.0:1787383345.520002:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:0.0:1787383345.520015:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+14:11264:x1874206965933184:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1787383345.520055:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383345.520084:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e9aa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340276c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.520239:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.520256:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e995 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340275e expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.520275:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.520317:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340275e expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.520332:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e995 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340275e expref: 15 pid: 6520 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383345.520348:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984896384:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383345.520482:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618141780 going to sleep for 11 seconds 00000100:00100000:1.0:1787383345.524258:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383345.524405:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984896384:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383345.524440:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383345.525642:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965933312 00000100:00100000:3.0:1787383345.525656:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965933312 00010000:00010000:3.0:1787383345.525711:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e995 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340275e expref: 16 pid: 6520 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383345.525750:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:3.0:1787383345.525760:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+16:2401:x1874206965933312:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383345.525815:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383345.525824:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e995 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340275e expref: 16 pid: 6520 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.525838:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340275e expref: 16 pid: 6520 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.525865:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e995 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340275e expref: 16 pid: 6520 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.525886:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:3.0:1787383345.525892:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.525904:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.525934:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.526116:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.526125:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383345.526161:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787383345.526343:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532e9aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340276c expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.526360:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340276c expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.526368:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:2.0:1787383345.526371:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787383345.526373:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16800, rc 0) 00000100:00100000:2.0:1787383345.526455:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+16:11264:x1874206965933184:12345-192.168.203.2@tcp:101:bash.0 Request processed in 6443us (6708us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787383345.526464:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 67 00010000:00010000:3.0:1787383345.527300:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383345.527347:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+15:2401:x1874206965933312:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1585us (3100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383345.527356:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:1.0:1787383345.532309:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383345.532641:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965933568 00000100:00100000:3.0:1787383345.532654:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965933568 00000100:00100000:3.0:1787383345.532729:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:3.0:1787383345.532741:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+15:11264:x1874206965933568:12345-192.168.203.2@tcp:36:bash.0 00010000:00010000:3.0:1787383345.533335:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e9bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.533358:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e9bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.533371:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e9bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787383345.533424:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1787383345.533449:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001b2c0b13 reply state 00000000272d59e0 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e9bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.533464:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e9bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.533473:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:3.0:1787383345.533476:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787383345.533498:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787383345.533722:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+18:11264:x1874206965933568:12345-192.168.203.2@tcp:36:bash.0 Request processed in 980us (1426us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1787383345.533730:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00000020:00080000:3.0:1787383345.533737:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787383345.544110:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383345.544339:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965933696 00000100:00100000:3.0:1787383345.544353:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965933696 00000100:00100000:3.0:1787383345.545297:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:3.0:1787383345.545314:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+18:11264:x1874206965933696:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1787383345.545345:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383345.545374:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e9c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402773 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.545527:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e9cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.545545:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340276c expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.545555:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e9cd lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.545600:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340276c expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.545616:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340276c expref: 19 pid: 6521 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383345.545634:0:10098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963605596300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984896512:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383345.545747:0:10098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383345.552923:0:10098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963605596300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984896512:192.168.203.2@tcp:104: 00010000:00010000:3.0:1787383345.552965:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e9cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383345.555928:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383345.556393:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965933824 00000100:00100000:3.0:1787383345.556407:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965933824 00010000:00010000:3.0:1787383345.556460:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340276c expref: 20 pid: 6521 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383345.556504:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:3.0:1787383345.556514:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+20:2402:x1874206965933824:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383345.556534:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383345.556542:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340276c expref: 20 pid: 6521 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.556558:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340276c expref: 20 pid: 6521 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.556585:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532e9b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340276c expref: 20 pid: 6521 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.556605:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:3.0:1787383345.556611:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e9cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.556622:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e9cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.556644:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e9cd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.556685:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383345.556824:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+19:2402:x1874206965933824:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 253us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383345.556834:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 58 00010000:00010000:1.0:1787383345.557382:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e9cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.557392:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e9cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383345.557464:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787383345.557469:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787383345.557510:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e9cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.557553:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e9c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402773 expref: 19 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.557571:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e9cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402773 expref: 18 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.557580:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:1.0:1787383345.557583:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383345.557586:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601654e00, rc 0) 00000100:00100000:1.0:1787383345.557741:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+18:11264:x1874206965933696:12345-192.168.203.2@tcp:101:bash.0 Request processed in 12433us (13660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383345.557751:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:1.0:1787383345.571028:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383345.571115:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965934080 00000100:00100000:0.0:1787383345.571129:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965934080 00000100:00100000:0.0:1787383345.571206:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:0.0:1787383345.571217:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628e5b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+18:11264:x1874206965934080:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:0.0:1787383345.571520:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628e5b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+19:11264:x1874206965934080:12345-192.168.203.2@tcp:35:bash.0 Request processed in 303us (505us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787383345.571528:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:2.0:1787383345.714176:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383345.714539:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965934336 00000100:00100000:0.0:1787383345.714554:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965934336 00000100:00100000:0.0:1787383345.714638:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:0.0:1787383345.714650:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+19:11274:x1874206965934336:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383345.714709:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383345.714739:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532e9d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340277a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383345.715258:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787383345.715398:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532e9d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340277a expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.715415:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628fc9800) 00010000:00010000:0.0:1787383345.715419:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383345.715424:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532e9d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340277a expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383345.715442:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16000, rc 0) 00000100:00100000:0.0:1787383345.715591:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+20:11274:x1874206965934336:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 942us (1429us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1787383345.715602:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:1.0:1787383345.729877:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383345.730089:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965934464 00000100:00100000:3.0:1787383345.730102:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965934464 00000100:00100000:3.0:1787383345.730231:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:3.0:1787383345.730243:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+20:11274:x1874206965934464:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:3.0:1787383345.730354:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e9e2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730374:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e9e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730388:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e9e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730404:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e9e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730410:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730416:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730537:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e9f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730560:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730567:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383345.730634:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730649:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e9e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730656:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e9e2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730663:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e9e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730670:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383345.730675:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e9e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730683:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e9e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730696:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:3.0:1787383345.730700:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383345.730705:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e9e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730712:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532e9e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730737:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e9e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730968:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e9e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730976:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e9e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730982:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383345.730985:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e9e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.730992:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e9e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.731000:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff963628ebf700) 00010000:00010000:3.0:1787383345.731003:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383345.731006:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e9e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.731012:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532e9e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.731030:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e9f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.731036:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e9f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.731042:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e9f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.731053:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383345.731057:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e9f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.731063:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e9f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.731073:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:3.0:1787383345.731076:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383345.731078:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e9f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383345.731084:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532e9f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383345.731187:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+20:11274:x1874206965934464:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 944us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383345.731198:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:1.0:1787383345.733539:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383345.734628:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965934720 00000100:00100000:0.0:1787383345.734642:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965934720 00000100:00100000:0.0:1787383345.734723:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:0.0:1787383345.734735:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+20:11274:x1874206965934720:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383345.735070:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+21:11274:x1874206965934720:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 337us (1540us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787383345.735080:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383345.793637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383345.794572:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965934976 00000100:00100000:1.0:1787383345.794599:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965934976 00000100:00100000:1.0:1787383345.794684:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:1.0:1787383345.794696:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+21:11277:x1874206965934976:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383345.794763:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383345.794847:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e9f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402781 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.794949:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e9fe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.794968:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e9fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.794993:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e9fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795013:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795020:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795026:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795168:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ea0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795179:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ea0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795186:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ea0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383345.795196:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787383345.795305:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e9fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795313:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e9fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795321:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e9fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795326:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383345.795331:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e9fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795339:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e9fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795354:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:1.0:1787383345.795358:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383345.795363:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e9fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795370:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532e9fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795386:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795392:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795398:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795414:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383345.795418:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795424:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795432:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96350272e800) 00010000:00010000:1.0:1787383345.795435:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383345.795438:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea05 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795444:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795500:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532e9f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402781 expref: 24 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795515:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ea0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402781 expref: 23 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383345.795522:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:1.0:1787383345.795524:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383345.795527:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0c00, rc 0) 00000100:00100000:1.0:1787383345.795620:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+23:11277:x1874206965934976:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 925us (1996us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787383345.795628:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:1.0:1787383345.799851:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383345.800129:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965935104 00000100:00100000:2.0:1787383345.800145:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965935104 00000100:00100000:2.0:1787383345.800227:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:2.0:1787383345.800240:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+23:11277:x1874206965935104:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:2.0:1787383345.800344:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ea1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.800366:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ea1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.800381:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ea1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.800427:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ea1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.800435:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ea1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.800441:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ea1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.800447:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383345.800452:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ea1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.800461:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ea1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.800475:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:2.0:1787383345.800479:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383345.800484:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ea1a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.800490:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ea1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383345.800888:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+23:11277:x1874206965935104:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 650us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383345.800898:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:3.0:1787383345.802241:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383345.803698:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965935232 00000100:00100000:2.0:1787383345.803728:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965935232 00000100:00100000:2.0:1787383345.803855:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:2.0:1787383345.803867:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+23:2401:x1874206965935232:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383345.803889:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383345.803920:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ea0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402781 expref: 23 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383345.803947:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:2.0:1787383345.803952:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383345.804533:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+22:2401:x1874206965935232:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 667us (2298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383345.804543:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:1.0:1787383345.808705:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383345.808894:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965935488 00000100:00100000:0.0:1787383345.808908:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965935488 00000100:00100000:0.0:1787383345.808998:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:0.0:1787383345.809030:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+22:11277:x1874206965935488:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383345.809318:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+23:11277:x1874206965935488:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 290us (625us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787383345.809327:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00010000:00010000:2.0:1787383345.819179:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383346.053581:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383346.053971:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965935744 00000100:00100000:3.0:1787383346.053985:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965935744 00000100:00100000:3.0:1787383346.054089:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 74 00000100:00100000:3.0:1787383346.054103:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+23:11295:x1874206965935744:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1787383346.054136:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383346.054166:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532ea21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402788 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.054328:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ea28 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.054366:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ea28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.054383:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ea28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383346.054399:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787383346.054574:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532ea21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402788 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.054598:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ea28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402788 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.054609:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:3.0:1787383346.054612:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787383346.054616:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601654600, rc 0) 00000100:00100000:3.0:1787383346.054712:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+25:11295:x1874206965935744:12345-192.168.203.2@tcp:101:cat.0 Request processed in 610us (1145us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1787383346.054720:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 74 00000100:00080000:2.0:1787383346.054992:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383346.082883:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383346.082995:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965935872 00000100:00100000:0.0:1787383346.083009:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965935872 00000100:00100000:0.0:1787383346.083092:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 75 00000100:00100000:0.0:1787383346.083104:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+25:11296:x1874206965935872:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383346.083147:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383346.083177:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ea36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340278f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.083267:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532ea3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.083283:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532ea3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.083296:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532ea3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383346.083350:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787383346.083354:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383346.083377:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532ea3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.083405:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ea36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340278f expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.083452:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532ea3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340278f expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.083462:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:0.0:1787383346.083466:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383346.083470:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16800, rc 0) 00000100:00100000:0.0:1787383346.083545:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+26:11296:x1874206965935872:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 443us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.083553:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 75 00000100:00100000:0.0:1787383346.109494:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383346.109637:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965936256 00000100:00100000:1.0:1787383346.109648:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965936256 00000100:00100000:1.0:1787383346.109725:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:1.0:1787383346.109736:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+26:11296:x1874206965936256:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:1.0:1787383346.110556:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+27:11296:x1874206965936256:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 817us (1072us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787383346.110566:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:1.0:1787383346.116230:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383346.119425:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965936384 00000100:00100000:0.0:1787383346.119445:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965936384 00000100:00100000:0.0:1787383346.119662:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:0.0:1787383346.119675:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+27:11296:x1874206965936384:12345-192.168.203.2@tcp:103:lfs.0 00010000:00010000:0.0:1787383346.119695:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787383346.119730:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532e9cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402773 expref: 27 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.119814:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ea28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402788 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.119829:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532e8c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340272d expref: 25 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.119840:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383346.119876:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383346.119971:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+24:11296:x1874206965936384:12345-192.168.203.2@tcp:103:lfs.0 Request processed in 297us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.119981:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:2.0:1787383346.128437:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383346.132217:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965936512 00000100:00100000:3.0:1787383346.132238:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965936512 00000100:00100000:3.0:1787383346.132444:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 76 00000100:00100000:3.0:1787383346.132456:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+24:11296:x1874206965936512:12345-192.168.203.2@tcp:58:lfs.0 00010000:00010000:3.0:1787383346.132607:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532ea44 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.132628:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532ea44 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.132666:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532ea44 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787383346.133155:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383346.133484:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787383346.133582:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787383346.133929:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+24:11296:x1874206965936512:12345-192.168.203.2@tcp:58:lfs.0 Request processed in 1472us (5502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383346.133940:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 76 00000100:00100000:2.0:1787383346.165167:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383346.165283:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965936640 00000100:00100000:1.0:1787383346.165297:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965936640 00000100:00100000:1.0:1787383346.165371:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 77 00000100:00100000:1.0:1787383346.165381:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+24:11298:x1874206965936640:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383346.165409:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383346.165436:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402796 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.165513:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea52 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.165528:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.165540:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.165556:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.165580:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.165588:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.165678:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ea60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.165699:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ea60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.165711:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ea60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383346.165816:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787383346.165821:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787383346.165843:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ea60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.165855:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ea60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166054:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166065:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea52 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166072:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166091:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383346.166096:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166104:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea52 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166119:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:1.0:1787383346.166122:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383346.166127:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166133:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166149:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166156:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166162:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166168:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383346.166171:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166177:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166198:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96350272e800) 00010000:00010000:1.0:1787383346.166201:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383346.166204:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166210:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166252:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402796 expref: 26 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166267:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ea60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402796 expref: 25 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.166275:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:1.0:1787383346.166277:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383346.166280:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1400, rc 0) 00000100:00100000:1.0:1787383346.166354:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+25:11298:x1874206965936640:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 973us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383346.166363:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 77 00000100:00100000:0.0:1787383346.331180:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984896896:0@lo:400:kworker.0 00000100:00100000:2.0:1787383346.331227:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984897024:0@lo:400:kworker.0 00000100:00100000:2.0:1787383346.331273:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383346.331273:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383346.331341:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984896768:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.331425:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984897408:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.331450:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383346.331473:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984897920:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.331492:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383346.331549:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984896896 00000100:00100000:0.0:1787383346.331557:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984896896 00000100:00100000:0.0:1787383346.331607:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787383346.331616:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984896896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.331673:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984896896:12345-0@lo:400:kworker.0 Request processed in 57us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.331681:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787383346.331705:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984897024 00000100:00100000:0.0:1787383346.331708:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984897024 00000100:00100000:0.0:1787383346.331729:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984897408 00000100:00100000:0.0:1787383346.331731:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984897408 00000100:00100000:0.0:1787383346.331795:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984897920 00000100:00100000:0.0:1787383346.331798:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984897920 00000100:00100000:0.0:1787383346.331822:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787383346.331827:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984897024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.331856:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984897024:12345-0@lo:400:kworker.0 Request processed in 28us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.331881:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787383346.331894:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787383346.331899:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984897408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.331925:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984897408:12345-0@lo:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.331931:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787383346.331941:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787383346.331946:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984897920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.331965:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984897920:12345-0@lo:400:kworker.0 Request processed in 19us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.331970:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787383346.332011:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984896896:0@lo:400:kworker.0 00010000:00080000:0.0:1787383346.332024:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447ed80 x1874206984897408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383346.332035:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984897408:0@lo:400:kworker.0 00010000:00080000:0.0:1787383346.332044:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d91a680 x1874206984897920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383346.332051:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984897920:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.332153:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984896640:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.332186:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383346.332210:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984897152:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.332227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383346.332249:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984897664:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.332274:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383346.332292:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984898176:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.332313:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383346.332344:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984896640 00000100:00100000:0.0:1787383346.332348:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984896640 00000100:00100000:0.0:1787383346.332375:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787383346.332382:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984896640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.332420:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984896640:12345-0@lo:400:kworker.0 Request processed in 38us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.332426:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787383346.332455:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984897152 00000100:00100000:0.0:1787383346.332458:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984897152 00000100:00100000:0.0:1787383346.332480:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787383346.332486:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984897152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.332514:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984897152:12345-0@lo:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.332520:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787383346.332545:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984896640:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.332555:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984897152:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.332585:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984897664 00000100:00100000:0.0:1787383346.332589:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984897664 00000100:00100000:0.0:1787383346.332616:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984898176 00000100:00100000:0.0:1787383346.332619:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984898176 00000100:00100000:0.0:1787383346.332638:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787383346.332644:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984897664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.332685:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984897664:12345-0@lo:400:kworker.0 Request processed in 41us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.332691:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787383346.332701:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787383346.332706:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1874206984898176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.332727:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1874206984898176:12345-0@lo:400:kworker.0 Request processed in 21us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.332732:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787383346.332755:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984897664:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.332788:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984898176:0@lo:400:kworker.0 00000100:00080000:0.0:1787383346.332835:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383346.332841:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383346.337144:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984897024:0@lo:400:kworker.0 00000100:00100000:2.0:1787383346.337166:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984897536:0@lo:400:kworker.0 00000100:00100000:2.0:1787383346.337371:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383346.337435:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984898048:0@lo:400:kworker.0 00000100:00100000:2.0:1787383346.337461:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383346.337679:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984897536 00000100:00100000:2.0:1787383346.337687:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984897536 00000100:00100000:2.0:1787383346.337752:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984898048 00000100:00100000:2.0:1787383346.337756:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984898048 00000100:00100000:2.0:1787383346.337949:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787383346.337964:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984897536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383346.338056:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984897536:12345-0@lo:400:kworker.0 Request processed in 97us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383346.338064:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787383346.338083:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787383346.338090:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984898048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383346.338120:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984898048:12345-0@lo:400:kworker.0 Request processed in 30us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383346.338125:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1787383346.338155:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383346.338159:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383346.338193:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984897536:0@lo:400:kworker.0 00000100:00100000:2.0:1787383346.338207:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984898048:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.344101:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383346.344213:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984897280:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.344257:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383346.344373:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984897792:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.344390:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383346.344445:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984896768 00000100:00100000:1.0:1787383346.344452:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984896768 00000100:00100000:1.0:1787383346.344501:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984897280 00000100:00100000:1.0:1787383346.344504:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984897280 00000100:00100000:1.0:1787383346.344537:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787383346.344545:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984896768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383346.344614:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984896768:12345-0@lo:400:kworker.0 Request processed in 69us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383346.344622:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787383346.344647:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787383346.344655:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984897280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383346.344681:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984897280:12345-0@lo:400:kworker.0 Request processed in 28us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383346.344687:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:1.0:1787383346.344703:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383346.344976:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984896768:0@lo:400:kworker.0 00000100:00100000:0.0:1787383346.344990:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984897280:0@lo:400:kworker.0 00000100:00100000:1.0:1787383346.345047:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984897792 00000100:00100000:1.0:1787383346.345051:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984897792 00000100:00080000:0.0:1787383346.345102:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383346.345120:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787383346.345128:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984897792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383346.345265:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984897792:12345-0@lo:400:kworker.0 Request processed in 137us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383346.345272:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787383346.345336:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984897792:0@lo:400:kworker.0 00000040:00080000:0.0:1787383346.463092:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383346.463105:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383346.463152:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787383346.463167:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787383346.463363:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1874206984898304:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787383346.463498:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608cb6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383346.472432:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1874206984898304:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787383346.498961:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383346.499511:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965936768 00000100:00100000:3.0:1787383346.499524:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965936768 00000100:00100000:3.0:1787383346.499602:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 78 00000100:00100000:3.0:1787383346.499614:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+25:11309:x1874206965936768:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787383346.499657:0:10098:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787383346.499859:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+25:11309:x1874206965936768:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 247us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383346.500163:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 78 00000100:00100000:3.0:1787383346.505094:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383346.506101:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965936896 00000100:00100000:1.0:1787383346.506117:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965936896 00000100:00100000:1.0:1787383346.506200:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 79 00000100:00100000:1.0:1787383346.506212:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+25:11309:x1874206965936896:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787383346.506314:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea67 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.506334:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.506370:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.509777:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea6e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.509812:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.509829:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.509872:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.509881:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.509888:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383346.510186:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787383346.510192:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787383346.510210:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.510223:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.510229:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea67 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.510253:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea67 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.510258:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383346.510263:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea67 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.510269:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea67 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.510283:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628fc9400) 00010000:00010000:1.0:1787383346.510286:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383346.510291:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea67 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.510297:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea67 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.510312:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.510318:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea6e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.510323:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.510328:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383346.510331:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.511660:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea6e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.511688:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff96350272e800) 00010000:00010000:1.0:1787383346.511691:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383346.511697:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea6e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.511705:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea6e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.511729:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.511737:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.511744:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.511749:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383346.511753:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.511759:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.511781:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:1.0:1787383346.511784:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383346.511787:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.511821:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ea75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383346.511923:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+25:11309:x1874206965936896:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 Request processed in 5709us (6841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383346.512479:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 79 00000100:00100000:3.0:1787383346.517842:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383346.518110:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965937152 00000100:00100000:0.0:1787383346.518123:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965937152 00000100:00100000:0.0:1787383346.518202:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 80 00000100:00100000:0.0:1787383346.518215:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+25:11309:x1874206965937152:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383346.518255:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383346.518284:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ea7c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340279d expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518435:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ea83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518453:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ea83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518468:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ea83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383346.518482:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787383346.518609:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ea83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518618:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ea83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518626:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ea83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518656:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383346.518662:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ea83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518671:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ea83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518687:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383346.518690:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383346.518696:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ea83 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518702:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ea83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518758:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ea7c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340279d expref: 27 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518821:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628fc9400) 00010000:00010000:0.0:1787383346.518823:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383346.518828:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ea7c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340279d expref: 27 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.518839:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17200, rc 0) 00000100:00100000:0.0:1787383346.518937:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+26:11309:x1874206965937152:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 724us (1110us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1787383346.518946:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 80 00000100:00100000:0.0:1787383346.532685:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383346.532946:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965937280 00000100:00100000:2.0:1787383346.532960:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965937280 00000100:00100000:2.0:1787383346.533057:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 81 00000100:00100000:2.0:1787383346.533069:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+26:11309:x1874206965937280:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787383346.533130:0:6520:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787383346.533283:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+26:11309:x1874206965937280:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 216us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383346.533298:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 81 00000100:00100000:3.0:1787383346.541149:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383346.541226:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965937536 00000100:00100000:1.0:1787383346.541240:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965937536 00000100:00100000:1.0:1787383346.541328:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 82 00000100:00100000:1.0:1787383346.541340:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+26:11309:x1874206965937536:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383346.541368:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383346.541371:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787383346.541407:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532ea3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340278f expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.541431:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:1.0:1787383346.541437:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383346.541456:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea91 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027a4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787383346.542032:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787383346.542234:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.542252:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.542264:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.542340:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ea91 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027a4 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.542357:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027a4 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.542365:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96350272e800) 00010000:00010000:1.0:1787383346.542368:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383346.542370:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0e00, rc 0) 00000100:00100000:1.0:1787383346.542465:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+27:11309:x1874206965937536:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 1126us (1330us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787383346.542475:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 82 00000100:00100000:1.0:1787383346.562452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383346.562615:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965937792 00000100:00100000:3.0:1787383346.562629:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965937792 00000100:00100000:3.0:1787383346.562707:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 83 00000100:00100000:3.0:1787383346.562718:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+27:11309:x1874206965937792:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787383346.562837:0:10098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383346.562875:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ea98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027a4 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.562919:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff96350272e800) 00010000:00010000:3.0:1787383346.562934:0:10098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383346.562977:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eaa6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.562994:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eaa6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563005:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eaa6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563023:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eaad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xd40d9254 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563031:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eaad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd40d9254 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563038:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eaad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd40d9254 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563106:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eaa6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563113:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eaa6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563120:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eaa6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563127:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383346.563132:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eaa6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563148:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eaa6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563157:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:3.0:1787383346.563160:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383346.563164:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eaa6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563169:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eaa6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563181:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eaad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd40d9254 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563187:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eaad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd40d9254 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563193:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eaad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd40d9254 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563199:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383346.563202:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eaad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd40d9254 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563208:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eaad lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd40d9254 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563216:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xd40d9254 (ffff963628ebf500) 00010000:00010000:3.0:1787383346.563219:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383346.563222:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eaad lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd40d9254 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.563253:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eaad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd40d9254 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383346.563367:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+26:11309:x1874206965937792:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 649us (928us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787383346.563377:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 83 00000100:00100000:1.0:1787383346.567445:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383346.567914:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965937920 00000100:00100000:3.0:1787383346.567929:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965937920 00000100:00100000:3.0:1787383346.568040:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 84 00000100:00100000:3.0:1787383346.568053:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+26:11309:x1874206965937920:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383346.568083:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383346.568117:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532eab4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027ab expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.568165:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eabb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.568183:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eabb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.568197:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eabb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.568368:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532eab4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ab expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.568390:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eabb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ab expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.568413:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff963628ebf700) 00010000:00010000:3.0:1787383346.568416:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787383346.568421:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601654e00, rc 0) 00000100:00100000:3.0:1787383346.568512:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+27:11309:x1874206965937920:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 462us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383346.568521:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 84 00000100:00100000:1.0:1787383346.595552:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383346.596444:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965938176 00000100:00100000:2.0:1787383346.596460:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965938176 00000100:00100000:2.0:1787383346.596548:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 85 00000100:00100000:2.0:1787383346.596561:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+27:11309:x1874206965938176:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383346.596676:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eac2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.596697:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eac2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.596712:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eac2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383346.597016:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1787383346.597029:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379625261988ns, next at 380625258994ns, rc = 0 00000004:00010000:2.0:1787383346.597094:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000074cece8c reply state 000000009a86da92 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eac2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.597109:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eac2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.597118:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff963628ebf700) 00010000:00010000:2.0:1787383346.597121:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787383346.597125:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383346.597623:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+29:11309:x1874206965938176:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 1062us (2083us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787383346.597632:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 85 00000100:00100000:2.0:1787383346.608975:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383346.609932:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965938304 00000100:00100000:3.0:1787383346.609951:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965938304 00000100:00100000:3.0:1787383346.610048:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 86 00000100:00100000:3.0:1787383346.610061:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+29:11309:x1874206965938304:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383346.610096:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383346.610123:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eac9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027b2 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.610208:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eac9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027b2 expref: 30 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.610227:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eac9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027b2 expref: 30 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.611395:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff963628ebf700) 00010000:00010000:3.0:1787383346.611403:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383346.611408:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655400, rc 0) 00000100:00100000:3.0:1787383346.611513:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+30:11309:x1874206965938304:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 1451us (2543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383346.611545:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 86 00000100:00100000:1.0:1787383346.628133:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383346.638986:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965938432 00000100:00100000:2.0:1787383346.639011:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965938432 00000100:00100000:2.0:1787383346.639092:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:2.0:1787383346.639104:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1874206965938432:12345-192.168.203.2@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787383346.639155:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:2.0:1787383346.639200:0:8435:0:(genops.c:1406:class_connect()) connect: client a75c5b6d-4c9e-4295-9df6-097efce92717, cookie 0xc40acec91532ead0 00002000:00100000:2.0:1787383346.639216:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a75c5b6d-4c9e-4295-9df6-097efce92717/ffff963503114800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383346.639856:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787383346.640066:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787383346.640115:0:8435:0:(import.c:65:import_set_state_nolock()) ffff963503110800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383346.640330:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2400:x1874206965938432:12345-192.168.203.2@tcp:8:lhsmtool_posix.0 Request processed in 1226us (12211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383346.640342:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:0.0:1787383346.670392:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383346.670539:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965938560 00000100:00100000:3.0:1787383346.670554:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965938560 00000100:00100000:3.0:1787383346.670649:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:3.0:1787383346.670661:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:0:x1874206965938560:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787383346.671158:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787383346.682593:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1787383346.682615:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000100:00100000:3.0:1787383346.682857:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:0:x1874206965938560:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 12187us (12470us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787383346.682872:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:1.0:1787383346.694212:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383346.694389:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965938816 00000100:00100000:2.0:1787383346.694409:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965938816 00000100:00100000:2.0:1787383346.697895:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:2.0:1787383346.697914:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+30:11309:x1874206965938816:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787383346.699439:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+31:11309:x1874206965938816:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 1520us (5225us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1787383346.699453:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:1.0:1787383346.705032:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383346.705138:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965939072 00000100:00100000:0.0:1787383346.705152:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965939072 00000100:00100000:0.0:1787383346.705233:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 87 00000100:00100000:0.0:1787383346.705410:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+31:11309:x1874206965939072:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787383346.705558:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+31:11309:x1874206965939072:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 153us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.713413:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 87 00000100:00100000:3.0:1787383346.717538:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383346.717717:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965939200 00000100:00100000:1.0:1787383346.717729:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965939200 00000100:00100000:1.0:1787383346.717857:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 88 00000100:00100000:1.0:1787383346.717869:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+31:11309:x1874206965939200:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383346.717897:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383346.717926:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ead7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027b9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.718276:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532eade lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.718295:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532eade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.718310:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532eade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383346.718370:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787383346.718394:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532eade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.718427:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ead7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027b9 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.718448:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532eade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027b9 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.718459:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff963628ebf700) 00010000:00010000:1.0:1787383346.718462:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787383346.718467:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1000, rc 0) 00000100:00100000:1.0:1787383346.718549:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+32:11309:x1874206965939200:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 681us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383346.718557:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 88 00000100:00100000:0.0:1787383346.743016:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383346.743133:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965939328 00000100:00100000:3.0:1787383346.743148:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965939328 00000100:00100000:3.0:1787383346.743210:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:3.0:1787383346.743220:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206965939328:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383346.743244:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383346.743271:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e31b953/0xc40acec91532eae5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027c0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383346.743305:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a894e32, blocks: 0x0 00010000:00010000:3.0:1787383346.743331:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1787383346.743336:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383346.743347:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e31b953/0xc40acec91532eae5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c0 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.743370:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e31b953/0xc40acec91532eae5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c0 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.743406:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655c00, rc 0) 00000100:00100000:1.0:1787383346.743655:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2401:x1874206965939328:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 435us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383346.743666:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:0.0:1787383346.746403:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383346.746532:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965939584 00000100:00100000:3.0:1787383346.746545:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965939584 00000100:00100000:3.0:1787383346.746620:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 89 00000100:00100000:3.0:1787383346.746631:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+32:11309:x1874206965939584:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787383346.746757:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+32:11309:x1874206965939584:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 127us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383346.746797:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 89 00000100:00100000:0.0:1787383346.751595:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383346.751822:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965939712 00000100:00100000:2.0:1787383346.751835:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965939712 00000100:00100000:2.0:1787383346.751910:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:2.0:1787383346.751922:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:11309:x1874206965939712:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383346.751954:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383346.751984:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec91532eaec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027c7 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.752024:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e31b953/0xc40acec91532eae5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c0 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.752034:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383346.752038:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383346.752044:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec91532eaec lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c7 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.752088:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e31b953/0xc40acec91532eae5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c0 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.752108:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e31b953/0xc40acec91532eae5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c0 expref: 7 pid: 8436 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383346.752135:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cfb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874206984898432:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383346.752250:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350277bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383346.757100:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cfb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874206984898432:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383346.757159:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec91532eaec lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c7 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.757186:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7a00, rc 0) 00000100:00100000:1.0:1787383346.757263:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+7:11309:x1874206965939712:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 5344us (5683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383346.757275:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:2.0:1787383346.763372:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383346.765210:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965939840 00000100:00100000:1.0:1787383346.765227:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965939840 00010000:00010000:1.0:1787383346.765285:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e31b953/0xc40acec91532eae5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c0 expref: 7 pid: 8436 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383346.765336:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:1.0:1787383346.765346:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965939840:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383346.765364:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383346.765389:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e31b953/0xc40acec91532eae5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c0 expref: 7 pid: 8436 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.765406:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e31b953/0xc40acec91532eae5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c0 expref: 7 pid: 8436 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.765433:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e31b953/0xc40acec91532eae5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c0 expref: 7 pid: 8436 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.765452:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383346.765473:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383346.765484:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec91532eaec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c7 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.765496:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec91532eaec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c7 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.765542:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec91532eaec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c7 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383346.765560:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350441a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1874206984898560:192.168.203.2@tcp:105: 00000100:00100000:1.0:1787383346.765669:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636038ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383346.774208:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350441a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1874206984898560:192.168.203.2@tcp:105: 00010000:00010000:0.0:1787383346.774246:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383346.774310:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2402:x1874206965939840:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8964us (10949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.774322:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:1.0:1787383346.788723:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383346.789436:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965939968 00000100:00100000:2.0:1787383346.789451:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965939968 00002000:00100000:2.0:1787383346.789517:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff96350441b100 x1874206965939968/t0(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:132/0 lens 504/0 e 0 to 0 dl 1787383357 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383346.789531:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96350441b100 with x1874206965939968 ext(0->8) 00002000:00010000:2.0:1787383346.789550:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96350441b100 00000100:00100000:2.0:1787383346.789589:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:2.0:1787383346.789601:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2402:x1874206965939968:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787383346.796341:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2402:x1874206965939968:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 Request processed in 6724us (7610us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787383346.796359:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00002000:00100000:0.0:1787383346.796374:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff96350441b100 x1874206965939968/t4294967303(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:132/0 lens 504/448 e 0 to 0 dl 1787383357 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787383346.796386:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96350441b100 with x1874206965939968 ext(0->8) 00002000:00010000:0.0:1787383346.796394:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96350441b100 00000100:00100000:3.0:1787383346.805501:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383346.805595:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965940096 00000100:00100000:1.0:1787383346.805607:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965940096 00000100:00100000:1.0:1787383346.805689:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 90 00000100:00100000:1.0:1787383346.805700:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+32:11309:x1874206965940096:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787383346.809345:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1787383346.809368:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787383346.809419:0:6498:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:0.0:1787383346.809668:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e9bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.809702:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e9bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.809710:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e9bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.809717:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383346.809722:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e9bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.809731:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e9bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.809759:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383346.809763:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383346.809815:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e9bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.809822:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532e9bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.809848:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eac2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.809853:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eac2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.809859:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eac2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.809863:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383346.809873:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eac2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.809881:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eac2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.809892:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff963628ebf700) 00010000:00010000:0.0:1787383346.809895:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787383346.809898:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eac2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.809904:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eac2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383346.809918:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383346.809945:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350441a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984898688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787383346.810016:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383346.810203:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984898688 00000100:00100000:3.0:1787383346.810211:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+14:11309:x1874206965940096:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 Request processed in 4507us (4719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.810214:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984898688 00000100:00100000:3.0:1787383346.810226:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 90 00000100:00100000:0.0:1787383346.810270:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787383346.810280:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984898688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787383346.810434:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787383346.810437:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787383346 00002000:00010000:0.0:1787383346.810439:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787383346.810441:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787383346 -> 1787383346 00002000:00010000:0.0:1787383346.810444:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787383346.810495:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1874206984898688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (478us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787383346.810502:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:00080000:2.0:1787383346.810541:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787383346.810570:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:3.0:1787383346.810635:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96350441a680/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787383346.810645:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350441a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984898688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787383346.818082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383346.819614:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965940224 00000100:00100000:3.0:1787383346.819633:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965940224 00000100:00100000:3.0:1787383346.819715:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:3.0:1787383346.819727:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2401:x1874206965940224:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787383346.822633:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1787383346.822651:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1787383346.824283:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2401:x1874206965940224:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 Request processed in 3803us (5461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383346.824301:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:1.0:1787383346.828379:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383346.828458:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965940480 00000100:00100000:2.0:1787383346.828470:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965940480 00000100:00100000:2.0:1787383346.828540:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 91 00000100:00100000:2.0:1787383346.828552:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+14:11309:x1874206965940480:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383346.828626:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383346.828659:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532eade lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027b9 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.828681:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff963628ebf700) 00010000:00010000:2.0:1787383346.828687:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383346.828724:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532eaf3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.828865:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532eaf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.828879:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532eaf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383346.829036:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a409f83 reply state 00000000ab244f4e transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532eaf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.829114:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532eaf3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.829179:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff963628ebf700) 00010000:00010000:2.0:1787383346.829182:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787383346.829185:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383346.829354:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+15:11309:x1874206965940480:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 803us (982us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1787383346.829364:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 91 00000100:00100000:1.0:1787383346.841114:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383346.843038:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963605595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984898816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383346.843146:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383346.843248:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984898816 00000100:00100000:3.0:1787383346.843258:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984898816 00000100:00100000:3.0:1787383346.843318:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787383346.843328:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874206984898816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383346.843366:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383346.843417:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874206984898816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383346.843424:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787383346.843482:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963605595f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984898816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383346.843707:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383346.843719:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984898944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383346.843751:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383346.843820:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984898944 00000100:00100000:1.0:1787383346.843839:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984898944 00000100:00100000:1.0:1787383346.843864:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787383346.843870:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984898944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787383346.843881:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383346.843919:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984898944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383346.843925:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787383346.843948:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965940608 00000100:00100000:2.0:1787383346.843954:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965940608 00000100:00100000:1.0:1787383346.843955:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984898944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383346.844116:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:2.0:1787383346.844125:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2401:x1874206965940608:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787383346.844401:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787383346.844405:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787383346 -> 1787383345 00002000:00010000:2.0:1787383346.844407:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787383343 00002000:00010000:2.0:1787383346.844410:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787383346 -> 1787383345 00002000:00010000:2.0:1787383346.844413:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787383346.844488:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206965940608:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 364us (3384us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787383346.844635:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:1.0:1787383346.850643:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383346.850916:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965940864 00000100:00100000:2.0:1787383346.850929:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965940864 00000100:00100000:2.0:1787383346.851013:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 92 00000100:00100000:2.0:1787383346.851025:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+15:11309:x1874206965940864:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787383346.852110:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383346.852427:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.852461:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eabb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ab expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.852472:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.852594:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eabb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ab expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.852611:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eabb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ab expref: 15 pid: 6522 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383346.852630:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984899072:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383346.852860:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350277bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383346.856669:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383346.859024:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965940992 00000100:00100000:1.0:1787383346.859043:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965940992 00010000:00010000:1.0:1787383346.859110:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eabb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ab expref: 16 pid: 6522 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383346.859161:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:1.0:1787383346.859174:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+16:2402:x1874206965940992:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383346.859193:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383346.859200:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eabb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ab expref: 16 pid: 6522 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.859215:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eabb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ab expref: 16 pid: 6522 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.859243:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff963628ebf700) 00010000:00010000:1.0:1787383346.859249:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.859274:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.859282:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.859308:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383346.859392:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+16:2402:x1874206965940992:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 220us (2733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383346.859400:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00010000:00010000:2.0:1787383346.859727:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eabb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ab expref: 15 pid: 6522 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383346.859747:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984899072:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383346.859807:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.859817:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.859823:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.859867:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.859883:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.859890:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.859895:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383346.859911:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.859920:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.859931:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff963628ebf700) 00010000:00010000:2.0:1787383346.859934:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787383346.859938:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.859943:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eafa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383346.860001:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+14:11309:x1874206965940864:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 Request processed in 8978us (9369us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787383346.860009:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 92 00000100:00100000:3.0:1787383346.863933:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383346.864431:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965941120 00000100:00100000:1.0:1787383346.864444:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965941120 00000100:00100000:1.0:1787383346.864524:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:1.0:1787383346.864536:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362db0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965941120:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787383346.864595:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.864620:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec91532eaec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c7 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.864630:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383346.864634:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787383346.864639:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.864686:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec91532eaec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c7 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.864720:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec91532eaec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c7 expref: 7 pid: 8434 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383346.864834:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350441bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874206984899200:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383346.865056:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636038ade40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383346.868114:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350441bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874206984899200:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383346.868155:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383346.876894:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383346.879556:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965941248 00000100:00100000:2.0:1787383346.879599:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965941248 00010000:00010000:2.0:1787383346.879673:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec91532eaec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c7 expref: 8 pid: 8434 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383346.879740:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:2.0:1787383346.879752:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605597b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2402:x1874206965941248:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383346.879818:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383346.879847:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec91532eaec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c7 expref: 8 pid: 8434 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.879863:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec91532eaec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c7 expref: 8 pid: 8434 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.879896:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec91532eaec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027c7 expref: 8 pid: 8434 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.879929:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383346.879934:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383346.879941:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.879951:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.879985:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383346.880061:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605597b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965941248:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 310us (3179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383346.880078:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00010000:00010000:2.0:1787383346.880116:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.880125:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.880148:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.880157:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.880164:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.880171:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383346.880176:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.880185:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.880197:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.880217:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec91532eb01 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383346.880270:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362db0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2402:x1874206965941120:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 Request processed in 15737us (16353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383346.880278:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:3.0:1787383346.885520:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383346.885615:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965941504 00000100:00100000:0.0:1787383346.885628:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965941504 00000100:00100000:0.0:1787383346.886607:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 93 00000100:00100000:0.0:1787383346.886652:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+14:11309:x1874206965941504:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787383346.886784:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.886814:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532e948 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402750 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.886830:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.886877:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532e948 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402750 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.886893:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532e948 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402750 expref: 14 pid: 6522 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383346.886924:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984899328:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383346.887044:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608cb6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383346.892607:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984899328:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383346.892659:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383346.894707:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383346.894827:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965941632 00000100:00100000:0.0:1787383346.894839:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965941632 00010000:00010000:0.0:1787383346.894890:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532e948 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402750 expref: 15 pid: 6522 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383346.894946:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:0.0:1787383346.894958:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+15:2402:x1874206965941632:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383346.894977:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383346.894985:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532e948 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402750 expref: 15 pid: 6522 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.895009:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532e948 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402750 expref: 15 pid: 6522 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.895036:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532e948 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402750 expref: 15 pid: 6522 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.895054:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383346.895059:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.895070:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.895077:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.895116:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383346.895177:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+14:2402:x1874206965941632:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 221us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383346.895186:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00010000:00010000:2.0:1787383346.895331:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.895341:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.895571:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.895585:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eac9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027b2 expref: 14 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.895593:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.895645:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eac9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027b2 expref: 14 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.895659:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eac9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027b2 expref: 14 pid: 10098 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383346.895676:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984899456:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383346.895757:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350277b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383346.900545:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984899456:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383346.900587:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383346.901537:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383346.901613:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965941760 00000100:00100000:1.0:1787383346.901623:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965941760 00010000:00010000:1.0:1787383346.901678:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eac9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027b2 expref: 15 pid: 10098 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383346.901725:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:1.0:1787383346.901734:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+15:2402:x1874206965941760:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383346.901751:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383346.901759:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eac9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027b2 expref: 15 pid: 10098 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.901794:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eac9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027b2 expref: 15 pid: 10098 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.901831:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eac9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027b2 expref: 15 pid: 10098 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.901857:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff963628ebf700) 00010000:00010000:1.0:1787383346.901862:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.901873:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.901882:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383346.901922:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383346.901979:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+14:2402:x1874206965941760:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 245us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383346.901988:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00010000:00010000:0.0:1787383346.902071:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.902091:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787383346.902236:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1787383346.902373:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1787383346.902415:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1787383346.902509:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874206984899584:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787383346.902565:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383346.902604:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608cb96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383346.903059:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984899584 00000100:00100000:1.0:1787383346.903066:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984899584 00000100:00100000:1.0:1787383346.903112:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787383346.903119:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1874206984899584:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787383346.903209:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1874206984899584:12345-0@lo:1000:mdt00_002.0 Request processed in 89us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383346.903216:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787383346.903290:0:6522:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787383346.903297:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96350441a680, transno 4294967304 00000100:00100000:0.0:1787383346.903314:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874206984899584:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787383346.903447:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1787383346.903498:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874206984899712:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787383346.903529:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383346.903546:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383346.903727:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984899712 00000100:00100000:1.0:1787383346.903732:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984899712 00000100:00100000:1.0:1787383346.903845:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787383346.903854:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1874206984899712:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787383346.903974:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1874206984899712:12345-0@lo:1000:mdt00_002.0 Request processed in 122us (444us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787383346.903999:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787383346.906323:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874206984899712:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787383346.906919:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.906935:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.906944:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.906950:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383346.906956:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.906965:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.906985:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff963628ebf700) 00010000:00010000:2.0:1787383346.906988:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383346.906993:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.907000:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb0f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.907040:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532ea44 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.907047:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532ea44 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.907052:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532ea44 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.907073:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383346.907076:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532ea44 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.907082:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532ea44 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.907092:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:2.0:1787383346.907094:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383346.907097:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532ea44 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.907113:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532ea44 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.907143:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.907512:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ea60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402796 expref: 17 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.907524:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.907573:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ea60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402796 expref: 17 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.907589:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ea60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402796 expref: 17 pid: 10098 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383346.907632:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984899840:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383346.907741:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350277b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787383346.917620:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984899840:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383346.917669:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383346.920832:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383346.924720:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965941888 00000100:00100000:3.0:1787383346.924743:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965941888 00010000:00010000:2.0:1787383346.926433:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ea60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402796 expref: 18 pid: 10098 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383346.926500:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:2.0:1787383346.926515:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+18:2401:x1874206965941888:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383346.926532:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383346.926539:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ea60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402796 expref: 18 pid: 10098 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.926554:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ea60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402796 expref: 18 pid: 10098 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.926580:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ea60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402796 expref: 18 pid: 10098 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.926744:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:2.0:1787383346.926751:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.926762:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.926789:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383346.926840:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383346.926946:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.926956:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.926971:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.926980:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.926996:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.927002:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383346.927007:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.927017:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.927027:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383346.927030:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383346.927034:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.927041:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb16 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.927054:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.927061:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.927066:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.927072:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383346.927075:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.927093:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.927114:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff963628fc9a00) 00010000:00010000:0.0:1787383346.927116:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787383346.927120:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383346.927126:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532eb08 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383346.927345:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+17:11309:x1874206965941504:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 40703us (41835us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787383346.927356:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 93 00000020:00080000:0.0:1787383346.927362:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787383346.927546:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+16:2401:x1874206965941888:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1035us (6728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383346.927555:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000040:00080000:3.0:1787383346.927911:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383346.927917:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383346.927936:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787383346.927943:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787383346.935189:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383346.935469:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965942144 00000100:00100000:3.0:1787383346.935482:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965942144 00000100:00100000:3.0:1787383346.935561:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:3.0:1787383346.935573:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+16:11309:x1874206965942144:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787383346.935968:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787383346.936029:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1787383346.936071:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532eb1d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.936091:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532eb1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.936120:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532eb1d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.936130:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532eb1d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.936137:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532eb1d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.936144:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532eb1d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.936331:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787383346.936446:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+18:11309:x1874206965942144:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 872us (1264us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787383346.936455:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000020:00080000:3.0:1787383346.936462:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787383346.936494:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383346.936501:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532eb1d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.936509:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b6800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383346.936514:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532eb1d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.936535:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532eb1d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.936550:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff963628ebf700) 00010000:00010000:3.0:1787383346.936553:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787383346.936559:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532eb1d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.936565:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532eb1d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383346.936579:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383346.936581:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383346.936582:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383347.361479:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984899968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383347.361572:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383347.361699:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984899968 00000100:00100000:3.0:1787383347.361709:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984899968 00000100:00100000:3.0:1787383347.361788:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787383347.361810:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984899968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787383347.361852:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787383347.371876:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984899968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10063us (10288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383347.371896:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787383347.372403:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984899968:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787383347.493687:0:14209:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787383347.493701:0:14209:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787383347.493737:0:14209:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787383347.493747:0:14209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787383347.660211:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383347.660301:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965942400 00000100:00100000:2.0:1787383347.660315:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965942400 00000100:00100000:2.0:1787383347.660390:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 94 00000100:00100000:2.0:1787383347.660402:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+18:11319:x1874206965942400:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1787383347.660436:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383347.660466:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532eb24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027ce expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.660603:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eb2b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.660620:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eb2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.660636:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eb2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383347.660650:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787383347.660813:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532eb24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ce expref: 21 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.660861:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eb2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ce expref: 20 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.660871:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:2.0:1787383347.660874:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787383347.660877:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7000, rc 0) 00000100:00100000:2.0:1787383347.660949:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+20:11319:x1874206965942400:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 549us (753us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787383347.660958:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 94 00000100:00100000:2.0:1787383347.677720:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383347.684318:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965942528 00000100:00100000:1.0:1787383347.684340:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965942528 00000100:00100000:1.0:1787383347.687368:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 95 00000100:00100000:1.0:1787383347.687402:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+20:11319:x1874206965942528:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:1.0:1787383347.687524:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb39 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687545:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687558:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687575:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532eb40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687582:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532eb40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687610:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532eb40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687716:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532eb47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687724:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532eb47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687744:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532eb47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383347.687837:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532eb47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687853:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687860:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb39 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687867:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687873:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383347.687877:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687884:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb39 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687898:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:1.0:1787383347.687908:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383347.687914:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687921:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687937:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532eb40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687944:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532eb40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687950:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532eb40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687956:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383347.687958:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532eb40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687964:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532eb40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687971:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96350272e300) 00010000:00010000:1.0:1787383347.687974:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383347.687976:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532eb40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687982:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532eb40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.687998:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532eb47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.688013:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532eb47 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.688019:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532eb47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.688024:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383347.688028:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532eb47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.688034:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532eb47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.688043:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96350272e900) 00010000:00010000:1.0:1787383347.688045:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383347.688048:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532eb47 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.688054:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532eb47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383347.688169:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+20:11319:x1874206965942528:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 783us (10462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383347.688179:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 95 00000100:00100000:1.0:1787383347.810683:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383347.814143:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965942784 00000100:00100000:3.0:1787383347.814163:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965942784 00000100:00100000:3.0:1787383347.814243:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 96 00000100:00100000:3.0:1787383347.814254:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+20:11322:x1874206965942784:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383347.814283:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383347.814321:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532eb4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027d5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814421:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eb55 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814438:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eb55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814451:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eb55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814464:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eb5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814471:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eb5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814478:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eb5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814702:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532eb63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814712:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532eb63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814721:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532eb63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383347.814743:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787383347.814886:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eb55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814894:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eb55 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814906:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eb55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814912:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383347.814918:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eb55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814927:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eb55 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814941:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:3.0:1787383347.814946:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383347.814951:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eb55 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814958:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532eb55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814972:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eb5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814979:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eb5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814985:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eb5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.814990:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383347.814994:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eb5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.815009:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eb5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.815018:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96363d62c800) 00010000:00010000:3.0:1787383347.815021:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383347.815024:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eb5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.815030:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532eb5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.815081:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532eb4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027d5 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.815095:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532eb63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027d5 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.815104:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:3.0:1787383347.815107:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383347.815109:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655000, rc 0) 00000100:00100000:3.0:1787383347.815193:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+22:11322:x1874206965942784:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 940us (4522us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787383347.815202:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 96 00000100:00100000:3.0:1787383347.821256:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383347.821633:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965942912 00000100:00100000:0.0:1787383347.821648:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965942912 00000100:00100000:0.0:1787383347.821743:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 97 00000100:00100000:0.0:1787383347.821756:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+22:11322:x1874206965942912:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:0.0:1787383347.821875:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532eb71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383347.821897:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532eb71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383347.821911:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532eb71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383347.821958:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532eb71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383347.821976:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532eb71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383347.821983:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532eb71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383347.821990:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383347.821996:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532eb71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383347.822004:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532eb71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383347.822019:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:0.0:1787383347.822022:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383347.822028:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532eb71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383347.822035:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532eb71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383347.822130:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+22:11322:x1874206965942912:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 376us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383347.822138:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 97 00000100:00100000:3.0:1787383347.834363:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383347.834406:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965943168 00000100:00100000:3.0:1787383347.834418:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965943168 00000100:00100000:3.0:1787383347.834881:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1787383347.834917:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628e5a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+22:11322:x1874206965943168:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1787383347.835216:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628e5a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+23:11322:x1874206965943168:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 303us (866us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1787383347.835225:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1787383347.871472:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963605594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984900096:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787383347.872127:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383347.874872:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984900224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383347.874942:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383347.875064:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984900224 00000100:00100000:1.0:1787383347.875072:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984900224 00000100:00100000:1.0:1787383347.875150:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787383347.875160:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984900224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383347.875190:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1787383347.875239:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984900224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383347.875247:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787383347.875262:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383347.875456:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984900096 00000100:00100000:0.0:1787383347.875461:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984900096 00000100:00100000:0.0:1787383347.875485:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787383347.875493:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874206984900096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383347.875510:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1787383347.875544:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874206984900096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383347.875550:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787383347.875590:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984900224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383347.875623:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963605594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984900096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383347.888323:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383347.888364:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965943424 00000100:00100000:1.0:1787383347.888374:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965943424 00000100:00100000:1.0:1787383347.888443:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 98 00000100:00100000:1.0:1787383347.888455:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+23:10847:x1874206965943424:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1787383347.888478:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383347.888496:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532eb78 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027dc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.888596:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.888611:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532eb63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027d5 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.888621:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.888655:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532eb63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027d5 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383347.888671:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532eb63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027d5 expref: 24 pid: 6522 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383347.888705:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350441ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984900352:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383347.888817:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636038ade40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383347.900981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383347.901083:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350441ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984900352:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383347.901112:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383347.901396:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965943552 00000100:00100000:2.0:1787383347.901405:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965943552 00010000:00010000:2.0:1787383347.901442:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532eb63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027d5 expref: 25 pid: 6522 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383347.901540:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:2.0:1787383347.901549:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605596d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+25:2401:x1874206965943552:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383347.901563:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383347.901569:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532eb63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027d5 expref: 25 pid: 6522 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.901583:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532eb63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027d5 expref: 25 pid: 6522 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.901603:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532eb63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027d5 expref: 25 pid: 6522 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.901634:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:2.0:1787383347.901639:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.901648:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.901656:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.901686:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383347.901739:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605596d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+24:2401:x1874206965943552:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 191us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383347.901747:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 65 00010000:00010000:3.0:1787383347.905145:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.905162:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383347.905184:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787383347.905338:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532eb78 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027dc expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.905358:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027dc expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.905367:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:3.0:1787383347.905370:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787383347.905373:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0c00, rc 0) 00000100:00100000:3.0:1787383347.905453:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+24:10847:x1874206965943424:12345-192.168.203.2@tcp:101:bash.0 Request processed in 17000us (17154us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1787383347.905854:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 98 00000100:00100000:3.0:1787383347.912562:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383347.912851:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965943680 00000100:00100000:2.0:1787383347.912860:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965943680 00000100:00100000:2.0:1787383347.912918:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 99 00000100:00100000:2.0:1787383347.912929:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+24:10847:x1874206965943680:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1787383347.912952:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383347.912972:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb8d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027e3 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.913006:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.913018:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.913029:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.913143:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6e00/0xc40acec91532eb8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027e3 expref: 26 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.913160:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027e3 expref: 25 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.913169:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:2.0:1787383347.913172:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383347.913176:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7a00, rc 0) 00000100:00100000:2.0:1787383347.913233:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+25:10847:x1874206965943680:12345-192.168.203.2@tcp:101:bash.0 Request processed in 306us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383347.913241:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 99 00000100:00100000:0.0:1787383347.923187:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383347.923419:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965943936 00000100:00100000:3.0:1787383347.923436:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965943936 00000100:00100000:3.0:1787383347.923525:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 100 00000100:00100000:3.0:1787383347.923537:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+25:10847:x1874206965943936:12345-192.168.203.2@tcp:36:bash.0 00010000:00010000:3.0:1787383347.924298:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eb9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.924331:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eb9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.924344:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eb9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787383347.924407:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1787383347.924434:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064a2ac5f reply state 000000005b4a47d7 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eb9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.924449:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eb9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.924457:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:3.0:1787383347.924461:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787383347.924465:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787383347.924568:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1787383347.924699:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+29:10847:x1874206965943936:12345-192.168.203.2@tcp:36:bash.0 Request processed in 1163us (1519us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787383347.924709:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 100 00000020:00080000:3.0:1787383347.924715:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787383347.933051:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383347.933869:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965944064 00000100:00100000:3.0:1787383347.933881:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965944064 00000100:00100000:3.0:1787383347.935667:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 101 00000100:00100000:3.0:1787383347.935688:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+29:10847:x1874206965944064:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1787383347.935710:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383347.935727:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532eba2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027ea expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.935783:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532eba2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ea expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.935804:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532eba2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ea expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383347.935828:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:3.0:1787383347.935832:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383347.935835:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655600, rc 0) 00000100:00100000:3.0:1787383347.935947:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+30:10847:x1874206965944064:12345-192.168.203.2@tcp:101:bash.0 Request processed in 258us (3593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383347.935955:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 101 00000100:00100000:0.0:1787383347.947290:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383347.948994:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965944192 00000100:00100000:2.0:1787383347.949009:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965944192 00000100:00100000:2.0:1787383347.949088:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:2.0:1787383347.949098:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:10847:x1874206965944192:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1787383347.949115:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383347.949136:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec91532eba9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027f1 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383347.949161:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a894e31, atime: 0x6a894e2f, ctime: 0x6a894e31, blocks: 0x8 00010000:00010000:2.0:1787383347.949182:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1787383347.949187:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383347.949194:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec91532eba9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027f1 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.949234:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec91532eba9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027f1 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383347.949248:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f6e00, rc 0) 00000100:00100000:2.0:1787383347.949312:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:10847:x1874206965944192:12345-192.168.203.2@tcp:101:bash.0 Request processed in 216us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383347.949320:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:0.0:1787383347.951809:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383347.952015:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965944320 00000100:00100000:2.0:1787383347.952024:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965944320 00002000:00010000:2.0:1787383347.952059:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1787383347.952063:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503e90e00 with x1874206965944320 ext(0->18446744073709551615) 00002000:00010000:2.0:1787383347.952073:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963503e90e00. 00000100:00100000:2.0:1787383347.952099:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:2.0:1787383347.952107:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206965944320:12345-192.168.203.2@tcp:10:bash.0 00002000:00010000:2.0:1787383347.952364:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787383347.952368:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787383345 -> 1787383348 00002000:00010000:2.0:1787383347.952370:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1787383343 -> 1787383343 00002000:00010000:2.0:1787383347.952372:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787383345 -> 1787383348 00002000:00010000:2.0:1787383347.952374:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787383347.952600:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2401:x1874206965944320:12345-192.168.203.2@tcp:10:bash.0 Request processed in 492us (846us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787383347.952608:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00002000:00010000:2.0:1787383347.952612:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1787383347.952614:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503e90e00 with x1874206965944320 ext(0->18446744073709551615) 00002000:00010000:2.0:1787383347.952630:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963503e90e00. 00000100:00100000:1.0:1787383348.077376:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383348.077514:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965944448 00000100:00100000:2.0:1787383348.077528:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965944448 00000100:00100000:2.0:1787383348.077637:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 102 00000100:00100000:2.0:1787383348.077650:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+30:11336:x1874206965944448:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:2.0:1787383348.077755:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ebb0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.077835:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ebb0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.077852:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ebb0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.077871:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ebb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.077878:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ebb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.077885:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ebb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078006:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532ebbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078016:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532ebbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078023:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532ebbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383348.078102:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532ebbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078116:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ebb0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078123:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ebb0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078130:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ebb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078137:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383348.078141:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ebb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078149:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ebb0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078164:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:2.0:1787383348.078167:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383348.078172:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ebb0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078179:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532ebb0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078196:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ebb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078203:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ebb7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078216:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ebb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078222:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383348.078226:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ebb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078233:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ebb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078241:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9635032cd300) 00010000:00010000:2.0:1787383348.078244:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383348.078246:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ebb7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078253:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ebb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078270:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532ebbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078277:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532ebbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078283:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532ebbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078289:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383348.078292:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532ebbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078307:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532ebbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078316:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:2.0:1787383348.078319:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383348.078322:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532ebbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.078328:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532ebbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383348.078418:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+30:11336:x1874206965944448:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 770us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383348.078427:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 102 00000100:00080000:0.0:1787383348.081491:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383348.123030:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383348.123456:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965944704 00000100:00100000:3.0:1787383348.123470:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965944704 00000100:00100000:3.0:1787383348.123547:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 103 00000100:00100000:3.0:1787383348.123559:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+30:11339:x1874206965944704:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383348.123586:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383348.123624:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027f8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.123889:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebcc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.123929:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.123944:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.123961:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.123969:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.123976:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124125:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532ebda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124135:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532ebda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124142:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532ebda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383348.124154:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787383348.124382:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124391:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebcc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124398:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebcc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124411:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383348.124416:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebcc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124424:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebcc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124437:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:3.0:1787383348.124440:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383348.124444:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebcc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124451:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebcc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124467:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124473:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124479:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124484:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383348.124487:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124492:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124508:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96363d62c800) 00010000:00010000:3.0:1787383348.124510:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383348.124513:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebd3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124518:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124564:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027f8 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124576:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532ebda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027f8 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.124584:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:3.0:1787383348.124586:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787383348.124588:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963601655000, rc 0) 00000100:00100000:3.0:1787383348.124981:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+32:11339:x1874206965944704:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1422us (1963us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787383348.124989:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 103 00000100:00100000:1.0:1787383348.141123:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383348.141226:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965944832 00000100:00100000:3.0:1787383348.141239:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965944832 00000100:00100000:3.0:1787383348.141317:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 104 00000100:00100000:3.0:1787383348.141329:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+32:11339:x1874206965944832:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:3.0:1787383348.141426:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.141445:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027dc expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.141473:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.141533:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027dc expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.141548:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027dc expref: 32 pid: 6520 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383348.141563:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963605594700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984900480:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383348.141692:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787383348.144578:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383348.144690:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965945088 00000100:00100000:1.0:1787383348.144702:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965945088 00000100:00100000:1.0:1787383348.144822:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:1.0:1787383348.144834:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+33:6171:x1874206965945088:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787383348.145217:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+34:6171:x1874206965945088:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 384us (651us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787383348.145225:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1787383348.145956:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963605594700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984900480:192.168.203.2@tcp:104: 00010000:00010000:3.0:1787383348.145990:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383348.148015:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383348.148257:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965945216 00000100:00100000:2.0:1787383348.148269:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965945216 00010000:00010000:2.0:1787383348.148323:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027dc expref: 34 pid: 6520 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383348.148403:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:2.0:1787383348.148415:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+34:2401:x1874206965945216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383348.148433:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383348.148441:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027dc expref: 34 pid: 6520 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.148457:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027dc expref: 34 pid: 6520 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.148521:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532eb7f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027dc expref: 34 pid: 6520 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.148542:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:2.0:1787383348.148548:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.148561:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.148570:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.148604:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383348.148676:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+33:2401:x1874206965945216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 263us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383348.148684:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 66 00010000:00010000:3.0:1787383348.148998:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.149007:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.149069:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.149078:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.149086:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.149100:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383348.149106:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.149115:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.149125:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:3.0:1787383348.149128:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787383348.149131:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.149138:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebe8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383348.149198:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+32:11339:x1874206965944832:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 7871us (8089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383348.149206:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 104 00000100:00100000:0.0:1787383348.152634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383348.152869:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965945472 00000100:00100000:1.0:1787383348.152881:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965945472 00000100:00100000:1.0:1787383348.152953:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:1.0:1787383348.152963:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+32:11339:x1874206965945472:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:1.0:1787383348.153247:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+33:11339:x1874206965945472:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 285us (630us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787383348.153256:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:1.0:1787383348.256417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383348.256532:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965945728 00000100:00100000:3.0:1787383348.256547:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965945728 00000100:00100000:3.0:1787383348.256634:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 105 00000100:00100000:3.0:1787383348.256647:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+33:11350:x1874206965945728:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1787383348.256680:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383348.256721:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34027ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.256871:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebf6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.256911:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebf6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.256925:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebf6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.256944:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.256953:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.256962:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257102:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532ec04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257113:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532ec04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257122:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532ec04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383348.257135:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787383348.257247:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebf6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257256:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebf6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257265:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebf6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257279:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383348.257285:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebf6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257295:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebf6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257313:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:3.0:1787383348.257317:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383348.257323:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebf6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257330:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ebf6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257352:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257359:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebfd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257366:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257372:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383348.257376:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257383:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebfd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257403:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96363d62c800) 00010000:00010000:3.0:1787383348.257406:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383348.257409:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebfd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257416:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ebfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257470:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ebef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ff expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257489:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532ec04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ff expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.257498:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:3.0:1787383348.257501:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383348.257504:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636102b6800, rc 0) 00000100:00100000:3.0:1787383348.257617:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+35:11350:x1874206965945728:12345-192.168.203.2@tcp:101:cat.0 Request processed in 972us (1217us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787383348.257628:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 105 00000100:00100000:0.0:1787383348.262281:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383348.262427:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965945984 00000100:00100000:1.0:1787383348.262458:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965945984 00000100:00100000:1.0:1787383348.262538:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:1.0:1787383348.262550:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+35:11350:x1874206965945984:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1787383348.262990:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+36:11350:x1874206965945984:12345-192.168.203.2@tcp:35:cat.0 Request processed in 440us (723us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787383348.263000:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:1.0:1787383348.277189:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383348.277261:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383348.277370:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965946112 00000100:00100000:0.0:1787383348.277384:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965946112 00002000:00100000:0.0:1787383348.277469:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->7) req@ffff963504418e00 x1874206965946112/t0(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:134/0 lens 496/0 e 0 to 0 dl 1787383359 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787383348.277484:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963504418e00 with x1874206965946112 ext(0->7) 00002000:00010000:0.0:1787383348.277504:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963504418e00 00000100:00100000:0.0:1787383348.277545:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:0.0:1787383348.277556:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2404:x1874206965946112:12345-192.168.203.2@tcp:4:cat.0 00000100:00100000:3.0:1787383348.278613:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965946240 00000100:00100000:3.0:1787383348.278625:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965946240 00000100:00100000:3.0:1787383348.278676:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:3.0:1787383348.278685:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+11:2404:x1874206965946240:12345-192.168.203.2@tcp:16:kworker.0 00000100:00080000:1.0:1787383348.279818:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383348.281287:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+11:2404:x1874206965946112:12345-192.168.203.2@tcp:4:cat.0 Request processed in 3720us (4099us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787383348.281310:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00002000:00100000:1.0:1787383348.281326:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->7) req@ffff963504418e00 x1874206965946112/t4294967308(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:134/0 lens 496/448 e 0 to 0 dl 1787383359 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787383348.281339:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963504418e00 with x1874206965946112 ext(0->7) 00002000:00010000:1.0:1787383348.281347:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963504418e00 00000001:00080000:0.0:1787383348.289322:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1787383348.289369:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:3.0:1787383348.289589:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965946240:12345-192.168.203.2@tcp:16:kworker.0 Request processed in 10896us (12318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383348.289611:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:1.0:1787383348.308242:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383348.308395:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965946496 00000100:00100000:3.0:1787383348.308410:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965946496 00000100:00100000:3.0:1787383348.308491:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 106 00000100:00100000:3.0:1787383348.308503:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+36:11351:x1874206965946496:12345-192.168.203.2@tcp:36:rm.0 00010000:00010000:3.0:1787383348.308649:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1787383348.308696:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655600/0xc40acec91532eba2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ea expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.308745:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636102b6800/0xc40acec91532ec04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ff expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.308763:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655000/0xc40acec91532ebda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027f8 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.309075:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532eb94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027e3 expref: 33 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.309091:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:3.0:1787383348.309100:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383348.309140:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ec12 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.309159:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ec12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.309173:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ec12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.309194:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ec19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.309212:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ec19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.309219:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ec19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.309332:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ec20 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.309342:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ec20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.309349:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ec20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787383348.309635:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1787383348.309648:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381337881377ns, next at 382337878149ns, rc = 0 00010000:00010000:3.0:1787383348.311112:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ec27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311136:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ec27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311148:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ec27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311157:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ec27 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311164:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ec27 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311190:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ec27 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311224:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383348.311254:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ec20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311261:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ec20 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311268:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ec20 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311274:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383348.311279:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ec20 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311287:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ec20 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311301:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:3.0:1787383348.311305:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787383348.311309:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ec20 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311317:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654600/0xc40acec91532ec20 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311345:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ec12 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311352:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ec12 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311364:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ec12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311369:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601654e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383348.311372:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ec12 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311378:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ec12 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311386:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:3.0:1787383348.311388:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383348.311391:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ec12 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311397:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601654e00/0xc40acec91532ec12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383348.311407:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039fb0a44 reply state 000000001567b514 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ec19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311418:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ec19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.311424:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96363d62c800) 00010000:00010000:3.0:1787383348.311427:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787383348.311430:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787383348.311538:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+34:11351:x1874206965946496:12345-192.168.203.2@tcp:36:rm.0 Request processed in 3030us (3307us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787383348.311548:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 106 00010000:00010000:2.0:1787383348.312889:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383348.312912:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ec27 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.312924:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030a00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383348.312928:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ec27 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.312938:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ec27 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.312956:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:2.0:1787383348.312973:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787383348.312978:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ec27 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.312984:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ec27 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.313002:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383348.313004:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383348.313006:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383348.373610:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383348.373724:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965946752 00000100:00100000:3.0:1787383348.373737:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965946752 00000100:00100000:0.0:1787383348.374071:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 107 00000100:00100000:0.0:1787383348.374085:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+34:11357:x1874206965946752:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1787383348.374119:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383348.374146:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532ec2e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402806 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.374281:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532ec35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.374298:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532ec35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.374312:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532ec35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.374335:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ec3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.374344:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ec3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.374351:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ec3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787383348.375012:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787383348.375189:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ec43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.375200:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ec43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.375229:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ec43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.375274:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532ec35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.375282:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532ec35 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.375288:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532ec35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.375295:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383348.375299:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532ec35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.375308:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532ec35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.375528:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:0.0:1787383348.375532:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383348.375538:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532ec35 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.375545:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532ec35 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383348.375561:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000b6332c8 reply state 0000000050cab4dd transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ec3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.375575:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ec3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.375588:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96363d62c800) 00010000:00010000:0.0:1787383348.375590:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383348.375593:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787383348.381894:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532ec2e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402806 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.381939:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ec43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402806 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.381950:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff963628fc9300) 00010000:00010000:1.0:1787383348.381953:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383348.381958:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17200, rc 0) 00000100:00100000:1.0:1787383348.382082:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+37:11357:x1874206965946752:12345-192.168.203.2@tcp:101:bash.0 Request processed in 7999us (8485us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787383348.382093:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 107 00000100:00100000:3.0:1787383348.391557:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383348.392173:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965946880 00000100:00100000:2.0:1787383348.392189:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965946880 00000100:00100000:2.0:1787383348.392289:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:2.0:1787383348.392302:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206965946880:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1787383348.392327:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383348.392357:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ec51 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340280d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383348.392392:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383348.392419:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=381s v=(0 0) 00010000:00010000:2.0:1787383348.392425:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383348.392435:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ec51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340280d expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.392468:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ec51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340280d expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.392487:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8400, rc 0) 00000100:00100000:2.0:1787383348.392562:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2401:x1874206965946880:12345-192.168.203.2@tcp:101:bash.0 Request processed in 263us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383348.392588:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00080000:1.0:1787383348.393409:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383348.397539:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383348.400018:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965947008 00000100:00100000:2.0:1787383348.400039:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965947008 00000100:00100000:2.0:1787383348.400128:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:2.0:1787383348.400140:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+8:11357:x1874206965947008:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1787383348.400163:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383348.400186:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402814 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.400228:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ec51 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340280d expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.400237:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383348.400242:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383348.400247:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.400291:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ec51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340280d expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.400307:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ec51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340280d expref: 9 pid: 8435 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383348.400324:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cfb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1874206984900608:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383348.400476:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350277bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383348.409354:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383348.409460:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965947136 00000100:00100000:3.0:1787383348.409473:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965947136 00010000:00010000:3.0:1787383348.409528:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ec51 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340280d expref: 10 pid: 8435 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383348.409577:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:3.0:1787383348.409587:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+10:2402:x1874206965947136:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383348.409620:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383348.409658:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ec51 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340280d expref: 10 pid: 8435 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.409676:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ec51 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340280d expref: 10 pid: 8435 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.409711:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383348.409717:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383348.409731:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.409743:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.409854:0:8450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383348.409898:0:8450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963605595880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8450:1874206984900736:192.168.203.2@tcp:105: 00000100:00100000:1.0:1787383348.410458:0:8450:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787383348.411319:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ec51 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340280d expref: 10 pid: 8435 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383348.411342:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cfb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1874206984900608:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383348.411376:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.411392:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8c00, rc 0) 00000100:00100000:0.0:1787383348.411445:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+9:11357:x1874206965947008:12345-192.168.203.2@tcp:101:bash.0 Request processed in 11307us (13921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383348.411455:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:1.0:1787383348.416256:0:8450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963605595880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8450:1874206984900736:192.168.203.2@tcp:105: 00010000:00010000:1.0:1787383348.416291:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383348.416375:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2402:x1874206965947136:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6788us (7036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383348.416388:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:3.0:1787383348.418223:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383348.418321:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965947392 00000100:00100000:1.0:1787383348.418342:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965947392 00000100:00100000:1.0:1787383348.418410:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:1.0:1787383348.418420:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+37:11357:x1874206965947392:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:1.0:1787383348.418867:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+38:11357:x1874206965947392:12345-192.168.203.2@tcp:35:bash.0 Request processed in 447us (653us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787383348.418876:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:3.0:1787383348.669537:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383348.669744:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965947520 00000100:00100000:0.0:1787383348.669758:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965947520 00000100:00100000:0.0:1787383348.669881:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 108 00000100:00100000:0.0:1787383348.669893:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+38:11372:x1874206965947520:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383348.669934:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383348.669962:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ec5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340281b expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.670045:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532ec66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.670084:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532ec66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.670097:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532ec66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383348.670158:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787383348.670162:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383348.670183:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532ec66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.670212:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ec5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340281b expref: 40 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.670234:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532ec66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340281b expref: 39 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.670244:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:0.0:1787383348.670247:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383348.670252:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17c00, rc 0) 00000100:00100000:0.0:1787383348.670328:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+39:11372:x1874206965947520:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 438us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383348.670336:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 108 00000100:00100000:2.0:1787383348.677423:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383348.677668:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965947776 00000100:00100000:3.0:1787383348.677682:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965947776 00000100:00100000:3.0:1787383348.677810:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 109 00000100:00100000:3.0:1787383348.677823:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+39:11372:x1874206965947776:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383348.677853:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383348.677879:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ec6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402822 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.678043:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ec74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.678061:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.678076:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ec74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383348.678089:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787383348.678230:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ec6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402822 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.678250:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ec74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402822 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.678283:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff963628fc9300) 00010000:00010000:3.0:1787383348.678287:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383348.678290:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600031400, rc 0) 00000100:00100000:3.0:1787383348.678485:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+41:11372:x1874206965947776:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 664us (1076us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1787383348.678494:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 109 00000100:00100000:3.0:1787383348.688490:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383348.688593:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965948032 00000100:00100000:1.0:1787383348.688607:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965948032 00000100:00100000:1.0:1787383348.688688:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 110 00000100:00100000:1.0:1787383348.688708:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+41:11372:x1874206965948032:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383348.688745:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383348.688815:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532ec82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402829 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.688951:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ec89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.688987:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ec89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.689001:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ec89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383348.689017:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787383348.689154:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532ec82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402829 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.689176:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ec89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402829 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.689186:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff963628fc9300) 00010000:00010000:1.0:1787383348.689189:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787383348.689194:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0e00, rc 0) 00000100:00100000:1.0:1787383348.689271:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+43:11372:x1874206965948032:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 573us (804us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1787383348.689279:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 110 00000100:00100000:0.0:1787383348.691747:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383348.691879:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965948160 00000100:00100000:1.0:1787383348.691891:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965948160 00000100:00100000:1.0:1787383348.691967:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:1.0:1787383348.691978:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+43:2402:x1874206965948160:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383348.691997:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383348.692025:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ec74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402822 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.692070:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff963628fc9300) 00010000:00010000:1.0:1787383348.692076:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383348.692140:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+42:2402:x1874206965948160:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 163us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383348.692149:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:2.0:1787383348.709439:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383348.709665:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965948288 00000100:00100000:1.0:1787383348.709678:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965948288 00000100:00100000:1.0:1787383348.709760:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:1.0:1787383348.709821:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2402:x1874206965948288:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:1.0:1787383348.709885:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.709921:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.709931:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383348.709936:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787383348.709942:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.709997:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.710014:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 8 pid: 8434 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383348.710055:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504418a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1874206984900864:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383348.710548:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636038ad780 going to sleep for 11 seconds 00000100:00100000:2.0:1787383348.723424:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383348.723723:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965948416 00000100:00100000:0.0:1787383348.723745:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965948416 00002000:00100000:0.0:1787383348.723867:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff963608cfb100 x1874206965948416/t0(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:134/0 lens 504/0 e 0 to 0 dl 1787383359 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787383348.723898:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963608cfb100 with x1874206965948416 ext(0->8) 00010000:00010000:0.0:1787383348.723922:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 9 pid: 8434 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383348.723945:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 9 pid: 8434 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383348.723956:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff963608cfb100 00000100:00100000:2.0:1787383348.724731:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:2.0:1787383348.724750:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965948416:12345-192.168.203.2@tcp:4:lfs.0 00000100:00100000:2.0:1787383348.726830:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+11:2402:x1874206965948416:12345-192.168.203.2@tcp:4:lfs.0 Request processed in 2072us (3421us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787383348.726847:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00002000:00100000:2.0:1787383348.726862:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff963608cfb100 x1874206965948416/t4294967303(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:134/0 lens 504/448 e 0 to 0 dl 1787383359 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383348.726873:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963608cfb100 with x1874206965948416 ext(0->8) 00000100:00100000:1.0:1787383348.726875:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504418a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1874206984900864:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383348.726884:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 11 pid: 8434 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.726905:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.726959:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 11 pid: 8434 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383348.727033:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff963608cfb100 00000001:00080000:2.0:1787383348.729095:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1787383348.729113:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1787383348.732963:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383348.733062:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965948544 00000100:00100000:2.0:1787383348.733072:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965948544 00010000:00010000:2.0:1787383348.733115:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 7 pid: 8434 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383348.733213:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:2.0:1787383348.733238:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636420d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206965948544:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383348.733253:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787383348.733270:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787383348.733284:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787383348 00002000:00010000:2.0:1787383348.733287:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787383348 00002000:00010000:2.0:1787383348.733288:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787383348 00002000:00010000:2.0:1787383348.733291:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787383348.733304:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 7 pid: 8434 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.733326:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 7 pid: 8434 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.733351:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075c50f5c/0xc40acec91532ec58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402814 expref: 7 pid: 8434 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.733368:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383348.733373:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383348.733380:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.733390:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.733425:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383348.733499:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636420d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2401:x1874206965948544:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 263us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383348.733516:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00010000:00010000:3.0:1787383348.733751:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.733762:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.734365:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.734375:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.734383:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.734391:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383348.734396:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.734414:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.734430:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383348.734439:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532ec97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383348.734569:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965948288:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 24741us (25147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383348.734578:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:3.0:1787383348.739739:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383348.739979:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965948800 00000100:00100000:1.0:1787383348.739989:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965948800 00000100:00100000:1.0:1787383348.740132:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:1.0:1787383348.740143:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628e58c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+42:11372:x1874206965948800:12345-192.168.203.2@tcp:35:lfs.0 00000004:00010000:1.0:1787383348.740206:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ec89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402829 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383348.743188:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1787383348.743243:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787383348.743584:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1787383348.743628:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.743647:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ec43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402806 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.743655:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.743692:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ec43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402806 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.743722:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ec43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402806 expref: 46 pid: 6522 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383348.743738:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504418a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874206984900992:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383348.743875:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383348.766263:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504418a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874206984900992:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383348.766293:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383348.768047:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383348.768175:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965948928 00000100:00100000:1.0:1787383348.768184:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965948928 00010000:00010000:1.0:1787383348.768226:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ec43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402806 expref: 47 pid: 6522 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383348.768267:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:1.0:1787383348.768277:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+47:2401:x1874206965948928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383348.768293:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383348.768301:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ec43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402806 expref: 47 pid: 6522 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.768314:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ec43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402806 expref: 47 pid: 6522 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.768336:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ec43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402806 expref: 47 pid: 6522 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.768370:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff963628fc9300) 00010000:00010000:1.0:1787383348.768375:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.768384:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.768391:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.768426:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383348.768473:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383348.768492:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+46:2401:x1874206965948928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 215us (450us total) trans 0 rc 0/0 00010000:00010000:2.0:1787383348.768493:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383348.768509:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00000001:00080000:2.0:1787383348.768624:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1787383348.768758:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1787383348.768897:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874206984901120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787383348.768944:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383348.768972:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350277b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383348.770016:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984901120 00000100:00100000:1.0:1787383348.770027:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984901120 00000100:00100000:1.0:1787383348.770135:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787383348.770145:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874206984901120:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787383348.770254:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874206984901120:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 110us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383348.770262:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787383348.770624:0:6524:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1787383348.770631:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1787383348.770648:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9636084b6d80, transno 4294967302 00000100:00100000:2.0:1787383348.770673:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874206984901120:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787383348.770845:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1787383348.770911:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874206984901248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787383348.770949:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383348.770970:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350277bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383348.771208:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984901248 00000100:00100000:1.0:1787383348.771214:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984901248 00000100:00100000:1.0:1787383348.771242:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787383348.771249:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874206984901248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787383348.771382:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1874206984901248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 133us (433us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787383348.771408:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787383348.773124:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874206984901248:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1787383348.773206:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787383348.773209:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1787383348.773264:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.773274:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.773308:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.773314:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383348.773318:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.773326:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.773342:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff963628fc9300) 00010000:00010000:2.0:1787383348.773345:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787383348.773350:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.773356:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ec9e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787383348.773474:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787383348.773540:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1787383348.773552:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381801785272ns, next at 382801783144ns, rc = 0 00000001:00080000:2.0:1787383348.774387:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1787383348.774436:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff963628fc9300) 00010000:00010000:2.0:1787383348.774440:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787383348.774448:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ec89 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402829 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383348.774586:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628e58c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+49:11372:x1874206965948800:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 34443us (34865us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787383348.774609:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000020:00080000:2.0:1787383348.774616:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787383348.779218:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383348.788055:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965949056 00000100:00100000:2.0:1787383348.788072:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965949056 00000100:00100000:2.0:1787383348.788147:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 111 00000100:00100000:2.0:1787383348.788158:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+49:11372:x1874206965949056:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1787383348.788183:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383348.788206:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eca5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402830 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.788264:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eca5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402830 expref: 50 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.788279:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eca5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402830 expref: 50 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383348.788296:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:2.0:1787383348.788300:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383348.788303:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8c00, rc 0) 00000100:00100000:3.0:1787383348.794721:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+50:11372:x1874206965949056:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 6554us (15501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383348.794742:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 111 00000100:00100000:0.0:1787383348.804464:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383348.804604:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965949312 00000100:00100000:3.0:1787383348.804614:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965949312 00000100:00100000:3.0:1787383348.804663:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:3.0:1787383348.805085:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+50:11372:x1874206965949312:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1787383348.809823:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+51:11372:x1874206965949312:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 5141us (5358us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787383348.809854:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00010000:00010000:2.0:1787383348.891047:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383348.929970:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383348.930146:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965949440 00000100:00100000:1.0:1787383348.930155:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965949440 00000100:00100000:1.0:1787383348.930396:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 112 00000100:00100000:1.0:1787383348.930406:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+51:11384:x1874206965949440:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:1.0:1787383348.930478:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ecac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930507:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ecac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930518:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ecac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930529:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930536:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930542:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930614:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ecba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930621:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ecba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930628:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ecba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383348.930688:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ecba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930700:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ecac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930706:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ecac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930712:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ecac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930718:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383348.930735:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ecac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930743:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ecac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.930755:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:1.0:1787383348.930757:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383348.930762:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ecac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932445:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ecac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932465:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932471:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932490:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932496:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383348.932500:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932507:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932520:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96363d62c800) 00010000:00010000:1.0:1787383348.932523:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383348.932526:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecb3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932532:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932542:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ecba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932549:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ecba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932554:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ecba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932559:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383348.932562:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ecba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932576:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ecba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932584:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:1.0:1787383348.932586:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383348.932589:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ecba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383348.932595:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ecba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383348.932677:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+51:11384:x1874206965949440:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 2269us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383348.932686:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 112 00000100:00100000:3.0:1787383349.059321:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383349.059493:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965949696 00000100:00100000:0.0:1787383349.059503:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965949696 00000100:00100000:0.0:1787383349.059575:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 113 00000100:00100000:0.0:1787383349.059585:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+51:11387:x1874206965949696:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383349.059604:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383349.059625:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532ecc1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402837 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.059694:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532ecc8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.059710:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532ecc8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.059732:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532ecc8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.059763:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532eccf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.060081:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532eccf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.060089:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532eccf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.060206:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532ecd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.060216:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532ecd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.060223:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532ecd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383349.060233:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787383349.060436:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532ecc8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.060444:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532ecc8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.060450:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532ecc8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.060462:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383349.060466:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532ecc8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.060485:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532ecc8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.060496:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:0.0:1787383349.060498:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383349.060503:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532ecc8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.061390:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16400/0xc40acec91532ecc8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.061407:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532eccf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.061414:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532eccf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.061421:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532eccf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.061426:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383349.061429:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532eccf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.061435:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532eccf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.061446:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96363d62c800) 00010000:00010000:0.0:1787383349.061448:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383349.061451:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532eccf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.061472:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532eccf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.062656:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532ecc1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402837 expref: 54 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.062680:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532ecd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402837 expref: 53 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.062688:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:0.0:1787383349.062691:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383349.062694:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16200, rc 0) 00000100:00100000:0.0:1787383349.062946:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+53:11387:x1874206965949696:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 3361us (3632us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787383349.062956:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 113 00000100:00100000:0.0:1787383349.089649:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383349.089738:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965949824 00000100:00100000:3.0:1787383349.089748:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965949824 00000100:00100000:3.0:1787383349.089848:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 114 00000100:00100000:3.0:1787383349.089860:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+53:11387:x1874206965949824:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:3.0:1787383349.089927:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ece4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.089943:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ece4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.089955:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ece4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.089990:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ece4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.089997:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ece4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.090004:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ece4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.090009:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383349.090014:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ece4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.090021:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ece4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.090051:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:3.0:1787383349.090054:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787383349.090058:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ece4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.090065:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ece4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383349.090139:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+53:11387:x1874206965949824:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 282us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383349.090147:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 114 00000100:00100000:2.0:1787383349.098501:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383349.100415:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965950080 00000100:00100000:1.0:1787383349.100428:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965950080 00000100:00100000:1.0:1787383349.100496:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:1.0:1787383349.100522:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+53:11387:x1874206965950080:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:1.0:1787383349.100760:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+54:11387:x1874206965950080:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 254us (2267us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1787383349.100803:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:0.0:1787383349.261553:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383349.261638:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965950336 00000100:00100000:1.0:1787383349.261646:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965950336 00000100:00100000:1.0:1787383349.261712:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:1.0:1787383349.261730:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+54:11396:x1874206965950336:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1787383349.261753:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383349.261756:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787383349.261845:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532ec66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340281b expref: 54 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.261865:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:1.0:1787383349.261870:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383349.261895:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532eceb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340283e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.261997:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecf2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.262011:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.262021:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383349.262031:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787383349.262124:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532eceb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340283e expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.262138:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340283e expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.262145:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:1.0:1787383349.262148:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383349.262150:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0800, rc 0) 00000100:00100000:1.0:1787383349.262213:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+55:11396:x1874206965950336:12345-192.168.203.2@tcp:101:bash.0 Request processed in 492us (669us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787383349.262220:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:0.0:1787383349.267457:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383349.267509:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383349.267572:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965950464 00000100:00100000:1.0:1787383349.267581:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965950464 00000100:00100000:1.0:1787383349.267638:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:1.0:1787383349.267649:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+55:11396:x1874206965950464:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1787383349.267671:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383349.267692:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ed00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402845 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.267742:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ed07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.267756:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ed07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.267808:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ed07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.267935:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ed00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402845 expref: 57 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.267955:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ed07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402845 expref: 56 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.267964:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:1.0:1787383349.267967:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787383349.267970:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0e00, rc 0) 00000100:00100000:1.0:1787383349.268020:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+56:11396:x1874206965950464:12345-192.168.203.2@tcp:101:bash.0 Request processed in 374us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383349.268029:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:2.0:1787383349.269136:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965950592 00000100:00100000:2.0:1787383349.269145:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965950592 00000100:00100000:2.0:1787383349.269190:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:2.0:1787383349.269198:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+56:2404:x1874206965950592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383349.269208:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383349.269224:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532ecf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340283e expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.269247:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:2.0:1787383349.269251:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383349.269293:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+55:2404:x1874206965950592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 95us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383349.269300:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:0.0:1787383349.279013:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383349.279274:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965950848 00000100:00100000:1.0:1787383349.279284:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965950848 00000100:00100000:1.0:1787383349.279342:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 117 00000100:00100000:1.0:1787383349.279351:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+55:11396:x1874206965950848:12345-192.168.203.2@tcp:36:bash.0 00010000:00010000:1.0:1787383349.279403:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383349.279429:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532ecd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402837 expref: 55 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.279457:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:1.0:1787383349.279462:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383349.279627:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ed0e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.279640:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ed0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.279649:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ed0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383349.279687:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1787383349.279727:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000084d51122 reply state 00000000d299ed12 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ed0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.279739:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ed0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383349.279746:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:1.0:1787383349.279748:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787383349.279750:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383349.279874:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+57:11396:x1874206965950848:12345-192.168.203.2@tcp:36:bash.0 Request processed in 523us (870us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787383349.280654:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 117 00000020:00080000:1.0:1787383349.280661:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787383349.288825:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383349.289327:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965950976 00000100:00100000:3.0:1787383349.289336:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965950976 00000100:00100000:3.0:1787383349.289394:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 118 00000100:00100000:3.0:1787383349.289404:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+57:11396:x1874206965950976:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1787383349.289428:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383349.289447:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340284c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.289552:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.289566:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.289576:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383349.289604:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787383349.289621:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383349.289640:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.289667:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340284c expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.289684:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340284c expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.289692:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:3.0:1787383349.289695:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383349.289699:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030400, rc 0) 00000100:00100000:3.0:1787383349.289763:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+58:11396:x1874206965950976:12345-192.168.203.2@tcp:101:bash.0 Request processed in 359us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383349.290117:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 118 00000100:00100000:0.0:1787383349.296126:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383349.296389:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965951232 00000100:00100000:1.0:1787383349.296398:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965951232 00000100:00100000:1.0:1787383349.296454:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:1.0:1787383349.296464:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+58:11396:x1874206965951232:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:1.0:1787383349.296744:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+59:11396:x1874206965951232:12345-192.168.203.2@tcp:35:bash.0 Request processed in 280us (625us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1787383349.296752:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:0.0:1787383349.305720:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383349.305952:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965951360 00000100:00100000:1.0:1787383349.305962:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965951360 00000100:00100000:1.0:1787383349.306020:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 380 00000100:00100000:1.0:1787383349.306031:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2403:x1874206965951360:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383349.306109:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2403:x1874206965951360:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 79us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383349.306117:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 380 00000100:00100000:0.0:1787383349.306237:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383349.306556:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965951616 00000100:00100000:1.0:1787383349.306561:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965951616 00000100:00100000:1.0:1787383349.306598:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:1.0:1787383349.306606:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965951616:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383349.306637:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965951616:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 31us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383349.306643:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:2.0:1787383349.307176:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383349.307205:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383349.307233:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383349.307292:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965951872 00000100:00100000:1.0:1787383349.307297:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965951872 00000100:00100000:1.0:1787383349.307365:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965951488 00000100:00100000:1.0:1787383349.307369:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965951488 00000100:00100000:1.0:1787383349.307386:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965951744 00000100:00100000:1.0:1787383349.307388:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965951744 00000100:00100000:1.0:1787383349.307403:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 282 00000100:00100000:1.0:1787383349.307409:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965951872:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383349.307446:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965951872:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383349.307452:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 282 00000100:00100000:1.0:1787383349.307466:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 283 00000100:00100000:1.0:1787383349.307471:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965951488:12345-192.168.203.2@tcp:400:kworker.0 00000100:00080000:2.0:1787383349.307602:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383349.307606:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383349.307631:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 284 00000100:00100000:2.0:1787383349.307640:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965951744:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383349.307680:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2403:x1874206965951744:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 41us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383349.307685:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 284 00000100:00100000:2.0:1787383349.307985:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2403:x1874206965951488:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 512us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383349.307992:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 283 00000100:00100000:3.0:1787383349.453132:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383349.453264:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965952000 00000100:00100000:2.0:1787383349.453273:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965952000 00000100:00100000:2.0:1787383349.453324:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 119 00000100:00100000:2.0:1787383349.453333:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+59:11403:x1874206965952000:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1787383349.453356:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383349.453374:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532ed23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402853 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.453449:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532ed2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.453462:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532ed2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.453485:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532ed2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383349.453529:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787383349.453533:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383349.453550:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532ed2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.453575:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532ed23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402853 expref: 61 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.453593:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532ed2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402853 expref: 60 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.453601:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:2.0:1787383349.453603:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383349.453606:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9800, rc 0) 00000100:00100000:2.0:1787383349.453664:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+60:11403:x1874206965952000:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 331us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383349.453671:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 119 00000100:00100000:0.0:1787383349.463032:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383349.463110:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965952128 00000100:00100000:3.0:1787383349.463120:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965952128 00000100:00100000:3.0:1787383349.463176:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 120 00000100:00100000:3.0:1787383349.463185:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+60:11403:x1874206965952128:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383349.463204:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383349.463223:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340285a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463282:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed38 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463296:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463321:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463334:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463342:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463348:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463418:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ed46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463428:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ed46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463435:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ed46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383349.463540:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787383349.463545:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383349.463564:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ed46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463575:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ed46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463582:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463599:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed38 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463605:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463611:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383349.463615:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463623:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed38 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463635:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:3.0:1787383349.463638:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383349.463642:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463648:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463663:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463669:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463675:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463680:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383349.463690:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463696:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463714:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96363d62c800) 00010000:00010000:3.0:1787383349.463716:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383349.463983:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.463991:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.464020:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340285a expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.464034:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ed46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340285a expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.464042:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:3.0:1787383349.464045:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383349.464047:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030800, rc 0) 00000100:00100000:3.0:1787383349.464104:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+61:11403:x1874206965952128:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 919us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383349.464112:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 120 00000100:00100000:1.0:1787383349.469183:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383349.469270:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383349.469459:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965952256 00000100:00100000:2.0:1787383349.469478:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965952256 00000100:00100000:2.0:1787383349.469549:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:2.0:1787383349.469559:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+61:2401:x1874206965952256:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383349.469574:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383349.469596:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ed46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340285a expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.469615:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:2.0:1787383349.469619:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383349.469664:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+60:2401:x1874206965952256:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 107us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383349.469673:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:3.0:1787383349.470362:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965952512 00000100:00100000:3.0:1787383349.470369:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965952512 00000100:00100000:3.0:1787383349.470411:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 121 00000100:00100000:3.0:1787383349.470419:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+60:11403:x1874206965952512:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383349.470445:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383349.470460:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ed4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402861 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.470568:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.470583:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340284c expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.470592:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.470626:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340284c expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.470640:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340284c expref: 61 pid: 6521 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383349.470653:0:10098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984901376:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383349.471037:0:10098:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383349.474218:0:10098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984901376:192.168.203.2@tcp:104: 00010000:00010000:3.0:1787383349.474246:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383349.482289:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383349.482477:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965952640 00000100:00100000:3.0:1787383349.482485:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965952640 00010000:00010000:3.0:1787383349.482520:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340284c expref: 62 pid: 6521 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383349.482572:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:3.0:1787383349.482580:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+62:2402:x1874206965952640:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383349.482596:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383349.482602:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340284c expref: 62 pid: 6521 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.482615:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340284c expref: 62 pid: 6521 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.482635:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340284c expref: 62 pid: 6521 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.482649:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:3.0:1787383349.482654:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.482664:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.482671:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.482708:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383349.482832:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+61:2402:x1874206965952640:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 251us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383349.482840:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 70 00010000:00010000:0.0:1787383349.483047:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.483068:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383349.483086:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787383349.483203:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ed4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402861 expref: 62 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.483220:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402861 expref: 61 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383349.483228:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:0.0:1787383349.483230:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787383349.483233:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030200, rc 0) 00000100:00100000:0.0:1787383349.483273:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+61:11403:x1874206965952512:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 12855us (14002us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787383349.483281:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 121 00000100:00100000:1.0:1787383349.493516:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383349.493866:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965952896 00000100:00100000:2.0:1787383349.493877:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965952896 00000100:00100000:2.0:1787383349.493943:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1787383349.493953:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+61:11403:x1874206965952896:12345-192.168.203.2@tcp:103:lfs.0 00010000:00010000:2.0:1787383349.493968:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383349.493992:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eca5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402830 expref: 61 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.494011:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:2.0:1787383349.494016:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383349.494072:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+60:11403:x1874206965952896:12345-192.168.203.2@tcp:103:lfs.0 Request processed in 121us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383349.494080:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1787383349.497891:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383349.498345:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965953024 00000100:00100000:3.0:1787383349.498368:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965953024 00000100:00100000:3.0:1787383349.498619:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 122 00000100:00100000:3.0:1787383349.498631:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+60:11403:x1874206965953024:12345-192.168.203.2@tcp:58:lfs.0 00010000:00010000:3.0:1787383349.498743:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.498761:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383349.498802:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787383349.498891:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787383349.498977:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+60:11403:x1874206965953024:12345-192.168.203.2@tcp:58:lfs.0 Request processed in 348us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383349.498994:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 122 00000100:00100000:3.0:1787383349.509822:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383349.510876:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965953152 00000100:00100000:2.0:1787383349.510887:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965953152 00000100:00100000:2.0:1787383349.511199:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:2.0:1787383349.511209:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+60:11403:x1874206965953152:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1787383349.511228:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383349.511248:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532ed69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402868 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.511299:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed62 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.511396:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532ed69 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402868 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.511418:0:6520:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.511431:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532ed69 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402868 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.511444:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:2.0:1787383349.511447:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383349.511452:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532ed69 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402868 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383349.511460:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8a00, rc 0) 00000100:00100000:2.0:1787383349.511625:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+61:11403:x1874206965953152:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 417us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383349.511633:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 123 00010000:00010000:2.0:1787383349.917335:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787383349.979095:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383349.979106:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383349.979228:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787383349.979238:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787383349.979371:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1874206984901504:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787383349.981227:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383349.985403:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1874206984901504:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787383349.985638:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383349.987821:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965953280 00000100:00100000:0.0:1787383349.987835:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965953280 00000100:00100000:0.0:1787383349.987976:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:0.0:1787383349.987989:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+61:11404:x1874206965953280:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787383349.988019:0:10098:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787383349.988132:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+61:11404:x1874206965953280:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 146us (2494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383349.988139:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:2.0:1787383350.002443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.002994:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965953408 00000100:00100000:3.0:1787383350.003002:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965953408 00000100:00100000:3.0:1787383350.003079:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00100000:3.0:1787383350.003090:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+61:11404:x1874206965953408:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787383350.003176:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed70 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003192:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003207:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003223:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed77 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003231:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003237:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003260:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003269:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003275:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383350.003318:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787383350.003323:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383350.003335:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003345:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003357:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed70 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003364:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003370:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383350.003375:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003381:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed70 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003393:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628fc9400) 00010000:00010000:3.0:1787383350.003396:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383350.003401:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed70 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003407:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ed70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003419:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003425:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed77 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003431:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003436:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383350.003446:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003452:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed77 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003459:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff96363d62cb00) 00010000:00010000:3.0:1787383350.003461:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383350.003464:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed77 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003481:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ed77 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003497:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003504:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003509:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003515:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383350.003518:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003524:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003531:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:3.0:1787383350.003534:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383350.003546:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.003551:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383350.003627:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+61:11404:x1874206965953408:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 Request processed in 538us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383350.003635:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00080000:2.0:1787383350.003949:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383350.006975:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383350.008288:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965953664 00000100:00100000:2.0:1787383350.008299:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965953664 00000100:00100000:2.0:1787383350.008399:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:2.0:1787383350.008409:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+61:11404:x1874206965953664:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383350.008430:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383350.008450:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532ed85 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340286f expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.008564:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ed8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.008579:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ed8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.008589:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ed8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383350.008600:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787383350.008687:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ed8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.008695:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ed8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.008973:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ed8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.008980:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383350.009009:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ed8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.009017:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ed8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.009030:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:2.0:1787383350.009034:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787383350.009038:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ed8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.009045:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ed8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.009086:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532ed85 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340286f expref: 63 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.009096:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628fc9400) 00010000:00010000:2.0:1787383350.009098:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383350.009102:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532ed85 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340286f expref: 63 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.009110:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8c00, rc 0) 00000100:00100000:2.0:1787383350.009210:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+62:11404:x1874206965953664:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 802us (2243us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1787383350.009217:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:1.0:1787383350.025717:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383350.027075:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965953792 00000100:00100000:0.0:1787383350.027087:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965953792 00000100:00100000:0.0:1787383350.027177:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 127 00000100:00100000:0.0:1787383350.027187:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+62:11404:x1874206965953792:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787383350.027219:0:10098:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787383350.027334:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+62:11404:x1874206965953792:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 148us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383350.027342:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 127 00000100:00100000:0.0:1787383350.044025:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.046945:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965954048 00000100:00100000:3.0:1787383350.046961:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965954048 00000100:00100000:3.0:1787383350.047578:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 128 00000100:00100000:3.0:1787383350.047590:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+62:11404:x1874206965954048:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383350.047608:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383350.047611:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787383350.047634:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532ed2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402853 expref: 62 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.047654:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:3.0:1787383350.047658:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383350.047672:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed9a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402876 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787383350.049278:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787383350.049435:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eda1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.049449:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eda1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.049471:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eda1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.049527:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532ed9a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402876 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.049543:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eda1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402876 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.049551:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96363d62cb00) 00010000:00010000:3.0:1787383350.049553:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383350.049557:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030c00, rc 0) 00000100:00100000:3.0:1787383350.049615:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+63:11404:x1874206965954048:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 2028us (5600us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787383350.049624:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 128 00000100:00100000:2.0:1787383350.059404:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383350.059684:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965954304 00000100:00100000:1.0:1787383350.059695:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965954304 00000100:00100000:1.0:1787383350.059948:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 129 00000100:00100000:1.0:1787383350.059961:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+63:11404:x1874206965954304:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787383350.060044:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383350.060071:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eda1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402876 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060087:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff96363d62cb00) 00010000:00010000:1.0:1787383350.060098:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383350.060125:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532edaf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060138:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532edaf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060149:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532edaf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060164:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532edb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x9abf476c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060170:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532edb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9abf476c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060177:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532edb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9abf476c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060220:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532edaf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060226:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532edaf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060232:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532edaf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060238:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383350.060242:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532edaf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060249:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532edaf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060267:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:1.0:1787383350.060269:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383350.060272:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532edaf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060277:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532edaf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060286:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532edb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x9abf476c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060291:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532edb6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9abf476c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060296:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532edb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9abf476c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060300:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383350.060303:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532edb6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9abf476c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060308:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532edb6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x9abf476c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060315:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x9abf476c (ffff96350272e900) 00010000:00010000:1.0:1787383350.060317:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383350.060320:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532edb6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9abf476c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.060326:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532edb6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x9abf476c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383350.060403:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+62:11404:x1874206965954304:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 444us (1010us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787383350.060410:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 129 00000100:00100000:1.0:1787383350.065635:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383350.065745:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965954432 00000100:00100000:2.0:1787383350.065756:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965954432 00000100:00100000:2.0:1787383350.066001:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 130 00000100:00100000:2.0:1787383350.066025:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+62:11404:x1874206965954432:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383350.066046:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383350.066069:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532edbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340287d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.066101:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532edc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.066114:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532edc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.066125:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532edc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.066221:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532edbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340287d expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.066238:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532edc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340287d expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.066247:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9635032cdb00) 00010000:00010000:2.0:1787383350.066249:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383350.066253:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9e00, rc 0) 00000100:00100000:2.0:1787383350.066311:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+63:11404:x1874206965954432:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 288us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383350.066319:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 130 00000100:00100000:2.0:1787383350.077563:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.077647:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965954688 00000100:00100000:3.0:1787383350.077658:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965954688 00000100:00100000:3.0:1787383350.077723:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 131 00000100:00100000:3.0:1787383350.077732:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+63:11404:x1874206965954688:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787383350.077930:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532edcb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.077946:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532edcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.077958:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532edcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787383350.078120:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1787383350.078129:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383106362713ns, next at 384106360286ns, rc = 0 00000004:00010000:3.0:1787383350.078175:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061ec68b1 reply state 00000000c66d6385 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532edcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.078187:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532edcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.078195:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9635032cdb00) 00010000:00010000:3.0:1787383350.078198:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787383350.078201:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787383350.078303:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+65:11404:x1874206965954688:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 571us (755us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787383350.078311:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 131 00000100:00100000:1.0:1787383350.088861:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383350.088958:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965954816 00000100:00100000:0.0:1787383350.088969:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965954816 00000100:00100000:0.0:1787383350.089031:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 132 00000100:00100000:0.0:1787383350.089041:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+65:11404:x1874206965954816:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383350.089065:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383350.089087:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532edd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402884 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.089153:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532edd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402884 expref: 66 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.089169:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532edd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402884 expref: 66 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.089197:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9635032cdb00) 00010000:00010000:0.0:1787383350.089201:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787383350.089205:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17200, rc 0) 00000100:00100000:0.0:1787383350.089272:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+66:11404:x1874206965954816:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 232us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383350.089280:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 132 00000100:00100000:2.0:1787383350.098365:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.098478:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965954944 00000100:00100000:3.0:1787383350.098487:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965954944 00000100:00100000:3.0:1787383350.098557:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:3.0:1787383350.098568:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965954944:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787383350.098817:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2404:x1874206965954944:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 251us (460us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787383350.098825:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00080000:2.0:1787383350.098925:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383350.123716:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383350.123921:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965955200 00000100:00100000:2.0:1787383350.123931:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965955200 00000100:00100000:2.0:1787383350.124000:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:2.0:1787383350.124011:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+66:11404:x1874206965955200:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787383350.124592:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+67:11404:x1874206965955200:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 581us (884us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1787383350.124601:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:0.0:1787383350.128884:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.129262:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965955456 00000100:00100000:3.0:1787383350.129273:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965955456 00000100:00100000:3.0:1787383350.129340:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:3.0:1787383350.129351:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+67:11404:x1874206965955456:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787383350.129456:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+67:11404:x1874206965955456:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 106us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383350.129477:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:1.0:1787383350.132377:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383350.132643:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965955584 00000100:00100000:2.0:1787383350.132654:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965955584 00000100:00100000:2.0:1787383350.132721:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:2.0:1787383350.132731:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+67:11404:x1874206965955584:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383350.132750:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383350.132816:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532edd9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340288b expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.132881:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532ede0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.132895:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532ede0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.132906:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532ede0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383350.132949:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383350.133229:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532ede0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.133258:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532edd9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340288b expref: 69 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.133289:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532ede0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340288b expref: 68 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.133298:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9635032cdb00) 00010000:00010000:2.0:1787383350.133302:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787383350.133305:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8e00, rc 0) 00000100:00100000:2.0:1787383350.133364:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+68:11404:x1874206965955584:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 634us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383350.133372:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:1.0:1787383350.137043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.137409:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965955712 00000100:00100000:3.0:1787383350.137419:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965955712 00000100:00100000:3.0:1787383350.137510:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:3.0:1787383350.137521:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965955712:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383350.137538:0:8914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383350.137557:0:8914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c338e05f/0xc40acec91532ede7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402892 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383350.137581:0:8914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a894e36, blocks: 0x0 00010000:00010000:3.0:1787383350.137598:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1787383350.137603:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383350.137613:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c338e05f/0xc40acec91532ede7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402892 expref: 8 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.137631:0:8914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c338e05f/0xc40acec91532ede7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402892 expref: 8 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.137644:0:8914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030600, rc 0) 00000100:00100000:3.0:1787383350.137712:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2402:x1874206965955712:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 193us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383350.137720:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:0.0:1787383350.153850:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383350.154105:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965955968 00000100:00100000:2.0:1787383350.154115:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965955968 00000100:00100000:2.0:1787383350.154173:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:2.0:1787383350.154183:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+68:11404:x1874206965955968:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787383350.154286:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+68:11404:x1874206965955968:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 104us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383350.154294:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:2.0:1787383350.159553:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.159821:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965956096 00000100:00100000:3.0:1787383350.159831:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965956096 00000100:00100000:3.0:1787383350.159887:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:3.0:1787383350.159898:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:11404:x1874206965956096:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383350.159928:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383350.159945:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005082dbfb/0xc40acec91532edee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402899 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.160383:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c338e05f/0xc40acec91532ede7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402892 expref: 9 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.160395:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383350.160399:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383350.160404:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005082dbfb/0xc40acec91532edee lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402899 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.160452:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c338e05f/0xc40acec91532ede7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402892 expref: 9 pid: 8914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.160465:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c338e05f/0xc40acec91532ede7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402892 expref: 9 pid: 8914 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383350.160480:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636012adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1874206984901632:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383350.160575:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350277bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383350.175575:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636012adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1874206984901632:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383350.175612:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005082dbfb/0xc40acec91532edee lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402899 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.175634:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600031000, rc 0) 00000100:00100000:2.0:1787383350.175695:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+9:11404:x1874206965956096:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 15798us (16150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383350.175704:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:3.0:1787383350.192289:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383350.192881:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965956224 00000100:00100000:1.0:1787383350.192891:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965956224 00010000:00010000:1.0:1787383350.192933:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c338e05f/0xc40acec91532ede7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402892 expref: 9 pid: 8914 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383350.192983:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:1.0:1787383350.192993:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965956224:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383350.193007:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383350.193030:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c338e05f/0xc40acec91532ede7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402892 expref: 9 pid: 8914 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.193044:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c338e05f/0xc40acec91532ede7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402892 expref: 9 pid: 8914 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.193077:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c338e05f/0xc40acec91532ede7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402892 expref: 9 pid: 8914 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.193114:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383350.193118:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383350.193127:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005082dbfb/0xc40acec91532edee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402899 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.193346:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005082dbfb/0xc40acec91532edee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402899 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.193392:0:8450:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005082dbfb/0xc40acec91532edee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402899 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383350.193407:0:8450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8450:1874206984901760:192.168.203.2@tcp:105: 00000100:00100000:1.0:1787383350.193541:0:8450:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787383350.205618:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383350.205703:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965956352 00000100:00100000:0.0:1787383350.205712:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965956352 00002000:00100000:0.0:1787383350.205811:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9636084b4a80 x1874206965956352/t0(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:136/0 lens 504/0 e 0 to 0 dl 1787383361 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787383350.205822:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9636084b4a80 with x1874206965956352 ext(0->12) 00002000:00010000:0.0:1787383350.205827:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9636084b4a80 00000100:00100000:0.0:1787383350.205864:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:0.0:1787383350.205875:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965956352:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787383350.207704:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+11:2402:x1874206965956352:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 Request processed in 1823us (2086us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787383350.207723:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00002000:00100000:0.0:1787383350.207734:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9636084b4a80 x1874206965956352/t4294967310(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:136/0 lens 504/448 e 0 to 0 dl 1787383361 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787383350.207745:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9636084b4a80 with x1874206965956352 ext(0->12) 00002000:00010000:0.0:1787383350.207751:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9636084b4a80 00000100:00100000:2.0:1787383350.207928:0:8450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8450:1874206984901760:192.168.203.2@tcp:105: 00010000:00010000:2.0:1787383350.207968:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383350.207993:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+10:2402:x1874206965956224:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 15001us (15713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383350.208002:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:2.0:1787383350.217859:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.218053:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965956480 00000100:00100000:3.0:1787383350.218292:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965956480 00000100:00100000:3.0:1787383350.218404:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 136 00000100:00100000:3.0:1787383350.218415:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+68:11404:x1874206965956480:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787383350.221164:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00010000:00010000:0.0:1787383350.221302:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532eaf3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221316:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532eaf3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221324:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532eaf3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221330:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383350.221344:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532eaf3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221353:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532eaf3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221370:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff963628ebf700) 00010000:00010000:0.0:1787383350.221373:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383350.221378:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532eaf3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221384:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91532eaf3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221414:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eb9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221421:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eb9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221426:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eb9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221430:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383350.221433:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eb9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221438:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eb9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221446:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff96363d62c000) 00010000:00010000:0.0:1787383350.221448:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383350.221568:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eb9b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221575:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655c00/0xc40acec91532eb9b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221591:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ec19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221597:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ec19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221603:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ec19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221608:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383350.221611:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ec19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221616:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ec19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221624:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96363d62c800) 00010000:00010000:0.0:1787383350.221626:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383350.221628:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ec19 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221633:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963601655400/0xc40acec91532ec19 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221641:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ec3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221656:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ec3c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221661:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ec3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221666:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383350.221669:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ec3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221675:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ec3c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221682:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96363d62c800) 00010000:00010000:0.0:1787383350.221684:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383350.221687:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ec3c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221692:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532ec3c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221707:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ed0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221713:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ed0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221727:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ed0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221732:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383350.221740:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ed0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221746:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ed0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.221755:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:0.0:1787383350.221757:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383350.221760:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ed0e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787383350.221859:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1787383350.221896:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787383350.221915:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96350277b0c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787383350.221919:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963503dedd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96350277b3c0 00000020:00080000:1.0:1787383350.221922:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963503ded600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff963502332c00 00000100:00100000:3.0:1787383350.222162:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984902016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787383350.222229:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383350.222259:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383350.222264:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984901888:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787383350.222284:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383350.222311:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984902016 00000100:00100000:3.0:1787383350.222318:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984902016 00000100:00100000:3.0:1787383350.222360:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984901888 00000100:00100000:3.0:1787383350.222364:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984901888 00000100:00100000:3.0:1787383350.222383:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787383350.222391:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984902016:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1787383350.222693:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532ed0e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.222709:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532edcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.222716:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532edcb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.222722:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532edcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.222727:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383350.222730:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532edcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.222736:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532edcb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.222746:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9635032cdb00) 00010000:00010000:0.0:1787383350.222748:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787383350.222758:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532edcb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.222797:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532edcb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383350.222912:0:8914:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787383350.222915:0:8914:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787383350 00002000:00010000:3.0:1787383350.222918:0:8914:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787383350.222920:0:8914:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787383350 -> 1787383350 00002000:00010000:3.0:1787383350.222921:0:8914:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000004:00080000:1.0:1787383350.223055:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787383350.223094:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff963608cb9d80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787383350.223098:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9635032c8100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff963608cb96c0 00000020:00080000:1.0:1787383350.223101:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9635032c8200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9636113b5800 00000100:00100000:3.0:1787383350.223660:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1874206984902016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1266us (1427us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787383350.223676:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787383350.223698:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787383350.223707:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984901888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787383350.223734:0:8914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1787383350.223753:0:8914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.223803:0:8914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec91532eba9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027f1 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.223812:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787383350.223816:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383350.223820:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.223848:0:8914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec91532eba9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027f1 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.223862:0:8914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec91532eba9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027f1 expref: 9 pid: 8435 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383350.223876:0:8914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8914:1874206984902272:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383350.223941:0:8914:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5240 going to sleep for 11 seconds 00000100:00080000:3.0:1787383350.223956:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1787383350.224237:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787383350.224288:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787383350.224321:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984902144:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787383350.224356:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383350.224389:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984902144 00000100:00100000:1.0:1787383350.224393:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984902144 00000100:00100000:1.0:1787383350.224420:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787383350.224427:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1874206984902144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787383350.224440:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00000100:00100000:0.0:1787383350.224645:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1787383350.224651:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1787383350.224673:0:3648:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff963503fd8380 x1874206984902016/t4294967311(4294967311) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787383366 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787383350.224684:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff963503fd8380/2, rc 0, transno 4294967311 00000100:00100000:0.0:1787383350.224688:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984902016:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787383350.225140:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a894e34, atime: 0x6a894e34, ctime: 0x6a894e34, blocks: 0x8 00010000:00010000:1.0:1787383350.225148:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532edfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.225161:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787383350.225165:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1787383350.225341:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+16:11404:x1874206965956480:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 Request processed in 6926us (7487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383350.225360:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 136 00000100:00080000:3.0:1787383350.225437:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787383350.225569:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532edfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.225589:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532edfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.225598:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532edfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.225605:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532edfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.225637:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383350.230660:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383350.230674:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532edfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.230688:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383350.230694:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532edfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.230715:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532edfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.230748:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532edfc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.230757:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532edfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.230847:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383350.230850:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383350.230852:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383350.231696:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1874206984902144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7263us (7333us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787383350.231718:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:0.0:1787383350.232114:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9636084b5c00/2, rc 0, transno 4294967305 00000100:00100000:0.0:1787383350.232121:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984902144:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787383350.235663:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383350.235758:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383350.236545:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965956608 00000100:00100000:0.0:1787383350.236556:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965956608 00000100:00100000:0.0:1787383350.236617:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:0.0:1787383350.236627:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+10:2401:x1874206965956608:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787383350.237800:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965956736 00000100:00100000:3.0:1787383350.237809:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965956736 00010000:00010000:3.0:1787383350.237843:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec91532eba9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027f1 expref: 11 pid: 8435 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383350.237876:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:3.0:1787383350.237883:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636420d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+11:2402:x1874206965956736:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383350.237897:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383350.237903:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec91532eba9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027f1 expref: 11 pid: 8435 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.237916:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec91532eba9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027f1 expref: 11 pid: 8435 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.237951:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383350.237956:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383350.237970:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.237981:0:7461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.238001:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383350.238054:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636420d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+11:2402:x1874206965956736:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 171us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383350.238072:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 72 00010000:00010000:3.0:1787383350.238150:0:8914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec91532eba9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027f1 expref: 10 pid: 8435 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383350.238191:0:8914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8914:1874206984902272:192.168.203.2@tcp:104: 00010000:00010000:3.0:1787383350.238209:0:8914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.238220:0:8914:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.238227:0:8914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.238237:0:8914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.238244:0:8914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.238260:0:8914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787383350.238413:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1874206984901888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14708us (16127us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787383350.238421:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1787383350.238438:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383350.238443:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.238475:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383350.238479:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787383350.241808:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff963503fda300/2, rc 0, transno 4294967312 00000100:00100000:0.0:1787383350.241823:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984901888:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787383350.248928:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.248973:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.248982:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079e97309/0xc40acec91532edf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383350.249333:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1787383350.249345:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:0.0:1787383350.249569:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2401:x1874206965956608:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 Request processed in 12938us (13909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383350.249580:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00010000:00010000:2.0:1787383350.254237:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383350.254244:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383350.254247:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383350.257252:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383350.257392:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965956992 00000100:00100000:2.0:1787383350.257402:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965956992 00000100:00100000:2.0:1787383350.257476:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 137 00000100:00100000:2.0:1787383350.257501:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+16:11404:x1874206965956992:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383350.257552:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383350.257579:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532ede0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340288b expref: 16 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.257599:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9635032cdb00) 00010000:00010000:2.0:1787383350.257604:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383350.257633:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ee03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.257646:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ee03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.257656:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ee03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383350.258310:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049a62903 reply state 000000008ec36675 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ee03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.258325:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ee03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.258332:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9635032cdb00) 00010000:00010000:2.0:1787383350.258335:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787383350.258337:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383350.258478:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+17:11404:x1874206965956992:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 978us (1233us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1787383350.258487:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 137 00000100:00100000:1.0:1787383350.263678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383350.263855:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965957120 00000100:00100000:2.0:1787383350.263864:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965957120 00000100:00100000:2.0:1787383350.263982:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:2.0:1787383350.263992:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2402:x1874206965957120:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787383350.264161:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787383350.264166:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1787383350 -> 1787383349 00002000:00010000:2.0:1787383350.264168:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787383348 00002000:00010000:2.0:1787383350.264179:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787383350 -> 1787383349 00002000:00010000:2.0:1787383350.264182:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787383350.264241:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965957120:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 250us (571us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787383350.264248:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:0.0:1787383350.268697:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.269125:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965957376 00000100:00100000:3.0:1787383350.269135:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965957376 00000100:00100000:3.0:1787383350.269280:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:3.0:1787383350.269290:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+17:11404:x1874206965957376:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787383350.269356:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.269371:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532edc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340287d expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.269380:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.269430:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532edc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340287d expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.269442:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532edc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340287d expref: 17 pid: 6520 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383350.269565:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fda680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984902400:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383350.269652:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5240 going to sleep for 11 seconds 00000100:00100000:1.0:1787383350.274761:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383350.275442:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965957504 00000100:00100000:0.0:1787383350.275460:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965957504 00010000:00010000:0.0:1787383350.275504:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532edc4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340287d expref: 18 pid: 6520 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383350.275594:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:0.0:1787383350.275603:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+18:2402:x1874206965957504:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383350.275616:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383350.275632:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532edc4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340287d expref: 18 pid: 6520 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.275643:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532edc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340287d expref: 18 pid: 6520 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.275663:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9635032cdb00) 00010000:00010000:0.0:1787383350.275667:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.275676:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.275682:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.275698:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383350.275761:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+18:2402:x1874206965957504:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 159us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383350.275801:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 73 00010000:00010000:3.0:1787383350.278227:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532edc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340287d expref: 17 pid: 6520 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383350.278251:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fda680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984902400:192.168.203.2@tcp:104: 00010000:00010000:3.0:1787383350.278274:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.278285:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.278290:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.278328:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.278336:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.278343:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.278365:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383350.278369:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.278376:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.278392:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9635032cdb00) 00010000:00010000:3.0:1787383350.278395:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787383350.278400:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.278407:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee0a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383350.278647:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+16:11404:x1874206965957376:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 Request processed in 9357us (9957us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787383350.278657:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:1.0:1787383350.282202:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.282449:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965957632 00000100:00100000:3.0:1787383350.282562:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965957632 00000100:00100000:0.0:1787383350.282720:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:0.0:1787383350.282741:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206965957632:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787383350.282822:0:8914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.282854:0:8914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005082dbfb/0xc40acec91532edee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402899 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.282862:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383350.282866:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383350.282871:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.282905:0:8914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005082dbfb/0xc40acec91532edee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402899 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.282918:0:8914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005082dbfb/0xc40acec91532edee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402899 expref: 7 pid: 8436 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383350.282944:0:8914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8914:1874206984902528:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383350.283192:0:8914:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383350.288722:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383350.288809:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965957760 00000100:00100000:2.0:1787383350.288818:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965957760 00010000:00010000:2.0:1787383350.288855:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005082dbfb/0xc40acec91532edee lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402899 expref: 8 pid: 8436 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383350.288892:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 74 00000100:00100000:2.0:1787383350.288901:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2402:x1874206965957760:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383350.288915:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383350.288946:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005082dbfb/0xc40acec91532edee lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402899 expref: 8 pid: 8436 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.289065:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005082dbfb/0xc40acec91532edee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402899 expref: 8 pid: 8436 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.289095:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383350.289099:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383350.289141:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.289150:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.289170:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383350.289233:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2402:x1874206965957760:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 333us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383350.289242:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 74 00010000:00010000:0.0:1787383350.291552:0:8914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005082dbfb/0xc40acec91532edee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402899 expref: 7 pid: 8436 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383350.291576:0:8914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8914:1874206984902528:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383350.291598:0:8914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.291610:0:8914:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.291634:0:8914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.291662:0:8914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.291670:0:8914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.291679:0:8914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.291686:0:8914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383350.291691:0:8914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.292113:0:8914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.292138:0:8914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.292147:0:8914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532ee11 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383350.292364:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2401:x1874206965957632:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 Request processed in 9633us (10169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383350.292374:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:1.0:1787383350.295443:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.295540:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965958016 00000100:00100000:3.0:1787383350.295548:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965958016 00000100:00100000:3.0:1787383350.295606:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00100000:3.0:1787383350.295615:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+16:11404:x1874206965958016:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787383350.295692:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.295709:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ed07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402845 expref: 16 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.295741:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.295804:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ed07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402845 expref: 16 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.295818:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ed07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402845 expref: 16 pid: 9499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383350.295833:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fda680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984902656:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383350.296155:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5240 going to sleep for 11 seconds 00000100:00100000:0.0:1787383350.299733:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383350.299762:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fda680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984902656:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383350.299821:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383350.299925:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965958144 00000100:00100000:3.0:1787383350.299941:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965958144 00010000:00010000:3.0:1787383350.299979:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ed07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402845 expref: 17 pid: 9499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383350.300018:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 75 00000100:00100000:3.0:1787383350.300028:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+17:2401:x1874206965958144:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383350.300043:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383350.300049:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ed07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402845 expref: 17 pid: 9499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.300062:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ed07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402845 expref: 17 pid: 9499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.300083:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ed07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402845 expref: 17 pid: 9499 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.300118:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:3.0:1787383350.300124:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532ed69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402868 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.300133:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.300140:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.300146:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.300180:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383350.300227:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+16:2401:x1874206965958144:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 200us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383350.300235:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 75 00010000:00010000:1.0:1787383350.300531:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.300538:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.300726:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.300738:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532edd2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402884 expref: 16 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.300746:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.300814:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532edd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402884 expref: 16 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.300828:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532edd2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402884 expref: 16 pid: 10098 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383350.300841:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984902784:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383350.300905:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383350.306845:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984902784:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383350.306872:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383350.309862:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383350.310825:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965958272 00000100:00100000:0.0:1787383350.310835:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965958272 00010000:00010000:0.0:1787383350.310877:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532edd2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402884 expref: 17 pid: 10098 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383350.310913:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 76 00000100:00100000:0.0:1787383350.310922:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+17:2401:x1874206965958272:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383350.310937:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383350.310944:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532edd2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402884 expref: 17 pid: 10098 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.310958:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532edd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402884 expref: 17 pid: 10098 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.310979:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532edd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402884 expref: 17 pid: 10098 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.310996:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9635032cdb00) 00010000:00010000:0.0:1787383350.311001:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.311011:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.311019:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.311065:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383350.311138:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+16:2401:x1874206965958272:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 217us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383350.311146:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 76 00010000:00010000:1.0:1787383350.311556:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.311565:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383350.311672:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1787383350.311858:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1787383350.311896:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1787383350.311971:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874206984902912:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787383350.312020:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383350.312055:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787383350.312101:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984902912 00000100:00100000:2.0:1787383350.312106:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984902912 00000100:00100000:2.0:1787383350.312148:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787383350.312156:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1874206984902912:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787383350.312245:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1874206984902912:12345-0@lo:1000:mdt00_002.0 Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383350.312252:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787383350.312474:0:6522:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787383350.312480:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff963503fd8380, transno 4294967311 00000004:00080000:1.0:1787383350.312498:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff963503fda300, transno 4294967312 00000100:00100000:1.0:1787383350.312506:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874206984902912:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787383350.312972:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1787383350.313021:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874206984903040:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787383350.313055:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383350.313069:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383350.313312:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984903040 00000100:00100000:2.0:1787383350.313317:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984903040 00000100:00100000:2.0:1787383350.313353:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787383350.313360:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1874206984903040:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787383350.313497:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1874206984903040:12345-0@lo:1000:mdt00_002.0 Request processed in 137us (441us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787383350.313504:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787383350.314662:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1874206984903040:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787383350.314796:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314807:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314815:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314820:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383350.314825:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314833:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314865:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9635032cdb00) 00010000:00010000:1.0:1787383350.314868:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383350.314872:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314877:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532ee1f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314900:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314905:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed62 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314910:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314914:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383350.314917:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314923:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed62 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314930:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:1.0:1787383350.314933:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383350.314940:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532ed69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402868 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314951:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532ed69 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402868 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.314968:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532ed69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402868 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.315001:0:6522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532ed69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402868 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383350.315013:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984903168:192.168.203.2@tcp:105: 00000100:00100000:1.0:1787383350.315865:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383350.321600:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.321686:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965958400 00000100:00100000:3.0:1787383350.321694:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965958400 00000100:00100000:3.0:1787383350.321746:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:3.0:1787383350.321755:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+20:11403:x1874206965958400:12345-192.168.203.2@tcp:49:lfs.0 00000100:00100000:3.0:1787383350.321908:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+20:11403:x1874206965958400:12345-192.168.203.2@tcp:49:lfs.0 Request processed in 152us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383350.321915:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:1.0:1787383350.325224:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984903168:192.168.203.2@tcp:105: 00010000:00010000:1.0:1787383350.325257:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed62 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325268:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532ed62 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325310:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ee26 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325325:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ee26 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325337:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ee26 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325347:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ee26 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325354:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ee26 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325374:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ee26 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325380:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383350.325384:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ee26 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325392:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ee26 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325404:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:1.0:1787383350.325408:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383350.325411:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ee26 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325417:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532ee26 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325428:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325435:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325441:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325446:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383350.325448:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.325466:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.326210:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:1.0:1787383350.326213:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787383350.326217:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383350.326224:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ee18 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383350.326389:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+19:11404:x1874206965958016:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 30772us (30952us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787383350.326400:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 139 00000020:00080000:1.0:1787383350.326405:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787383350.326817:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383350.326822:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383350.327726:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787383350.327738:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787383350.340095:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383350.340609:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383350.340668:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965958912 00000100:00100000:1.0:1787383350.340677:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965958912 00000100:00100000:3.0:1787383350.340691:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965958656 00000100:00100000:3.0:1787383350.340695:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965958656 00000100:00100000:3.0:1787383350.340736:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:1.0:1787383350.340736:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 140 00000100:00100000:3.0:1787383350.340746:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628e59850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+20:11404:x1874206965958656:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787383350.340746:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+20:11403:x1874206965958912:12345-192.168.203.2@tcp:58:lfs.0 00000004:00080000:3.0:1787383350.341166:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787383350.341383:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1787383350.341418:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ee2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.341434:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ee2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.341446:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ee2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.342106:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ee2d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.342113:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ee2d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.342120:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ee2d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.342143:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787383350.342833:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628e59850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+22:11404:x1874206965958656:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 2085us (2743us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787383350.342843:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 32 00000020:00080000:3.0:1787383350.342849:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787383350.343401:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383350.343409:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ee2d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.343419:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030600 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383350.343424:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ee2d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.343432:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ee2d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.343447:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9635032cdb00) 00010000:00010000:2.0:1787383350.343450:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787383350.343464:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ee2d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.343520:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ee2d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.343534:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383350.343583:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383350.343586:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787383350.346076:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787383350.346275:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+21:11403:x1874206965958912:12345-192.168.203.2@tcp:58:lfs.0 Request processed in 5526us (5661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383350.346286:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 140 00000100:00100000:2.0:1787383350.412533:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.412634:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965959040 00000100:00100000:3.0:1787383350.412645:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965959040 00000100:00100000:3.0:1787383350.412712:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 141 00000100:00100000:3.0:1787383350.412722:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+21:11406:x1874206965959040:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383350.412745:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383350.412805:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ee34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028a0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.412866:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ee3b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.412880:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ee3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.412892:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ee3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.412906:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ee42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.412914:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ee42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.412921:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ee42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.412997:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ee49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.413008:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402861 expref: 22 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.413035:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ee49 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.413068:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402861 expref: 22 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383350.413090:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402861 expref: 22 pid: 10098 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383350.413101:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984903296:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383350.413161:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037c5180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383350.415120:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984903296:192.168.203.2@tcp:104: 00010000:00010000:3.0:1787383350.415143:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ee49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383350.415982:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383350.416054:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965959296 00000100:00100000:3.0:1787383350.416060:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965959296 00000100:00100000:3.0:1787383350.416116:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:3.0:1787383350.416124:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+23:6171:x1874206965959296:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787383350.416324:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+24:6171:x1874206965959296:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 199us (343us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787383350.416332:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:0.0:1787383350.419539:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383350.419625:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965959424 00000100:00100000:2.0:1787383350.419634:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965959424 00010000:00010000:2.0:1787383350.419678:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402861 expref: 24 pid: 10098 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383350.419713:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 77 00000100:00100000:2.0:1787383350.419730:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635363800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+24:2401:x1874206965959424:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383350.419807:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383350.419815:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402861 expref: 24 pid: 10098 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.419829:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402861 expref: 24 pid: 10098 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.419849:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ed54 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402861 expref: 24 pid: 10098 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.419866:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:2.0:1787383350.419871:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ee49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.419880:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ee49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.419888:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ee49 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383350.419909:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383350.420002:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635363800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+23:2401:x1874206965959424:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 273us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383350.420010:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 77 00010000:00010000:0.0:1787383350.420191:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ee49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420199:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ee49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383350.420249:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787383350.420254:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383350.420271:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ee49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420283:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ee49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420293:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ee3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420300:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ee3b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420327:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ee3b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420334:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383350.420339:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ee3b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420353:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ee3b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420363:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:0.0:1787383350.420366:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383350.420370:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ee3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420376:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ee3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420387:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ee42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420393:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ee42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420399:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ee42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420404:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383350.420407:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ee42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420412:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ee42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420418:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff96363d62c100) 00010000:00010000:0.0:1787383350.420421:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383350.420423:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ee42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420437:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532ee42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420467:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ee34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028a0 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420479:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ee49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028a0 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383350.420486:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:0.0:1787383350.420488:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383350.420490:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600031400, rc 0) 00000100:00100000:0.0:1787383350.420514:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+22:11406:x1874206965959040:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 7795us (7991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383350.420521:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 141 00000100:00100000:0.0:1787383350.427599:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984903424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383350.427681:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383350.428124:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984903424 00000100:00100000:1.0:1787383350.428132:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984903424 00000100:00100000:1.0:1787383350.428182:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787383350.428190:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984903424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383350.428224:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383350.428861:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984903424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 669us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383350.428871:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787383350.432582:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984903424:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787383350.943792:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787383351.388132:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383351.388143:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383351.388170:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787383351.388183:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787383351.388309:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1874206984903552:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787383351.390827:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff963606513b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383351.401649:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1874206984903552:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787383351.407217:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383351.411135:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965959552 00000100:00100000:3.0:1787383351.411148:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965959552 00000100:00100000:3.0:1787383351.411407:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00100000:3.0:1787383351.411422:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+22:11417:x1874206965959552:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787383351.411457:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787383351.412634:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+22:11417:x1874206965959552:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 1214us (5422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383351.412646:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00100000:1.0:1787383351.416126:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383351.416413:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965959808 00000100:00100000:2.0:1787383351.416422:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965959808 00000100:00100000:2.0:1787383351.416481:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 143 00000100:00100000:2.0:1787383351.416501:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+22:11417:x1874206965959808:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383351.416521:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383351.416539:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532ee50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028a7 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.416640:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532ee57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.416655:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532ee57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.416669:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532ee57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383351.416680:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787383351.416990:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532ee50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028a7 expref: 25 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.417006:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532ee57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028a7 expref: 24 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.417014:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:2.0:1787383351.417017:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383351.417020:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9400, rc 0) 00000100:00100000:2.0:1787383351.417080:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+24:11417:x1874206965959808:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 580us (961us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787383351.417088:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 143 00000100:00100000:2.0:1787383351.420973:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383351.421066:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383351.421113:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965960192 00000100:00100000:2.0:1787383351.421122:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965960192 00000100:00100000:2.0:1787383351.421176:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:2.0:1787383351.421186:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+24:11417:x1874206965960192:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787383351.421257:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532ee65 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.421274:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532ee65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.421285:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532ee65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.421423:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532ee65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.421429:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532ee65 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.421433:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532ee65 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.421437:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383351.421440:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532ee65 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.421450:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532ee65 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.421459:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:2.0:1787383351.421461:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383351.421471:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532ee65 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383351.421478:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532ee65 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383351.421570:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+25:11417:x1874206965960192:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 386us (505us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787383351.421577:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:3.0:1787383351.422443:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965959936 00000100:00100000:3.0:1787383351.422452:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965959936 00000100:00100000:3.0:1787383351.422520:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:3.0:1787383351.422531:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+25:2401:x1874206965959936:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383351.422544:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383351.422562:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532ee57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028a7 expref: 25 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383351.422577:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:3.0:1787383351.422581:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383351.422917:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+24:2401:x1874206965959936:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 386us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383351.422924:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000040:00080000:3.0:1787383351.423861:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383351.423874:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787383351.423883:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383351.424564:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965960448 00000100:00100000:2.0:1787383351.424572:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965960448 00000100:00100000:2.0:1787383351.424616:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:2.0:1787383351.424625:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+24:11417:x1874206965960448:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787383351.425106:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+25:11417:x1874206965960448:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 480us (1221us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787383351.425114:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 34 00000040:00080000:3.0:1787383351.426227:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787383351.426240:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787383351.431686:0:14261:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383351.431695:0:14261:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383351.431727:0:14261:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787383351.431732:0:14261:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787383351.459542:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984903936:0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.459608:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383351.459654:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984904448:0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.459688:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383351.459713:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984904960:0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.459733:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383351.459761:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787383351.459796:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984904064:0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.459826:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383351.459845:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984904576:0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.459865:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383351.459881:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984905088:0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.459899:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383351.459935:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984903936 00000100:00100000:1.0:1787383351.459943:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984903936 00000100:00100000:1.0:1787383351.459990:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787383351.459999:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984903936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.460052:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984903936:12345-0@lo:400:kworker.0 Request processed in 53us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383351.460059:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787383351.460086:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984904448 00000100:00100000:1.0:1787383351.460091:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984904448 00000100:00100000:1.0:1787383351.460132:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984904960 00000100:00100000:1.0:1787383351.460135:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984904960 00000100:00100000:1.0:1787383351.460152:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984904064 00000100:00100000:1.0:1787383351.460154:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984904064 00000100:00100000:1.0:1787383351.460166:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787383351.460171:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984904448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.460201:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984904448:12345-0@lo:400:kworker.0 Request processed in 30us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383351.460207:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787383351.460217:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787383351.460222:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984904960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.460263:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984904960:12345-0@lo:400:kworker.0 Request processed in 24us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383351.460269:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787383351.460281:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787383351.460286:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984904064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.460309:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984904064:12345-0@lo:400:kworker.0 Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383351.460314:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787383351.460336:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984904576 00000100:00100000:1.0:1787383351.460339:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984904576 00000100:00100000:1.0:1787383351.460376:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984905088 00000100:00100000:1.0:1787383351.460380:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984905088 00000100:00100000:1.0:1787383351.460400:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787383351.460406:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984904576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.460435:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984904576:12345-0@lo:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383351.460449:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787383351.460460:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787383351.460465:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984905088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.460494:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984905088:12345-0@lo:400:kworker.0 Request processed in 29us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383351.460500:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1787383351.460520:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383351.460524:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383351.460527:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383351.460580:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984904064:0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.460592:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984904576:0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.460600:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984905088:0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.460608:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984903936:0@lo:400:kworker.0 00010000:00080000:1.0:1787383351.460617:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635045b6d80 x1874206984904448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383351.460627:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984904448:0@lo:400:kworker.0 00010000:00080000:1.0:1787383351.460637:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635045b6a00 x1874206984904960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383351.460644:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984904960:0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.460737:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984903680:0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.460796:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383351.460823:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984904192:0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.460856:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383351.460874:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984904704:0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.460894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383351.460911:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984905216:0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.460930:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383351.460949:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787383351.460955:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984903808:0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.460977:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383351.460992:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984904320:0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.461009:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383351.461022:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984904832:0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.461051:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383351.461080:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984903808 00000100:00100000:0.0:1787383351.461084:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984903808 00000100:00100000:0.0:1787383351.461130:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984904320 00000100:00100000:0.0:1787383351.461133:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984904320 00000100:00100000:0.0:1787383351.461157:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984904832 00000100:00100000:0.0:1787383351.461160:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984904832 00000100:00100000:0.0:1787383351.461177:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787383351.461182:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984903808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.461219:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984903808:12345-0@lo:400:kworker.0 Request processed in 36us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383351.461225:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787383351.461237:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787383351.461243:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984904320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.461269:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984904320:12345-0@lo:400:kworker.0 Request processed in 27us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383351.461281:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787383351.461293:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787383351.461298:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984904832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.461323:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984904832:12345-0@lo:400:kworker.0 Request processed in 25us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383351.461329:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787383351.461344:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984904704 00000100:00100000:0.0:1787383351.461347:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984904704 00000100:00100000:0.0:1787383351.461364:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984905216 00000100:00100000:0.0:1787383351.461367:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984905216 00000100:00100000:0.0:1787383351.461382:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787383351.461387:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984904704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.461417:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984904704:12345-0@lo:400:kworker.0 Request processed in 30us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383351.461423:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787383351.461433:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787383351.461439:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1874206984905216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.461465:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1874206984905216:12345-0@lo:400:kworker.0 Request processed in 26us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383351.461470:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1787383351.461487:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383351.461499:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984904192 00000100:00100000:0.0:1787383351.461502:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984904192 00000100:00100000:0.0:1787383351.461524:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787383351.461529:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984904192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.461558:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984904192:12345-0@lo:400:kworker.0 Request processed in 28us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383351.461570:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787383351.461608:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984903808:0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.461618:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984904320:0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.461627:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984904832:0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.461635:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984904192:0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.461644:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984904704:0@lo:400:kworker.0 00000100:00100000:0.0:1787383351.461653:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984905216:0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.464322:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984903680 00000100:00100000:1.0:1787383351.464336:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984903680 00000100:00100000:1.0:1787383351.464435:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1787383351.464446:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984903680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383351.464556:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984903680:12345-0@lo:400:kworker.0 Request processed in 113us (3759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383351.464564:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1787383351.464654:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984903680:0@lo:400:kworker.0 00000100:00100000:2.0:1787383351.598820:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383351.598933:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965960704 00000100:00100000:1.0:1787383351.598943:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965960704 00000100:00100000:1.0:1787383351.598996:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 145 00000100:00100000:1.0:1787383351.599006:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+25:11430:x1874206965960704:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383351.599029:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383351.599050:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ee6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028ae expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383351.599153:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ee73 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383351.599167:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ee73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383351.599179:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ee73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383351.599190:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787383351.599288:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532ee6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ae expref: 28 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383351.599307:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ee73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ae expref: 27 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383351.599316:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:1.0:1787383351.599325:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787383351.599329:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0200, rc 0) 00000100:00100000:1.0:1787383351.599385:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+27:11430:x1874206965960704:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 379us (573us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787383351.599392:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 145 00000100:00100000:3.0:1787383351.607501:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383351.607535:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965960832 00000100:00100000:3.0:1787383351.607545:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965960832 00000100:00100000:3.0:1787383351.607593:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 146 00000100:00100000:3.0:1787383351.607603:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+27:11430:x1874206965960832:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:3.0:1787383351.607664:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383351.607726:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383351.607738:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383351.607800:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383351.607807:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383351.607814:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383351.607821:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383351.607825:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383351.607832:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383351.607857:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:3.0:1787383351.607860:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787383351.607864:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383351.607870:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383351.607940:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+27:11430:x1874206965960832:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 338us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383351.607949:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 146 00000100:00100000:3.0:1787383351.729735:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383351.729957:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965960960 00000100:00100000:0.0:1787383351.729968:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965960960 00000100:00100000:0.0:1787383351.730029:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:0.0:1787383351.730039:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965960960:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1787383351.730056:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383351.730076:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec91532ee88 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028b5 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383351.730100:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a894e35, atime: 0x6a894e34, ctime: 0x6a894e35, blocks: 0x8 00010000:00010000:0.0:1787383351.730119:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1787383351.730123:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383351.730132:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec91532ee88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028b5 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383351.730150:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec91532ee88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028b5 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383351.730182:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16400, rc 0) 00000100:00100000:0.0:1787383351.730239:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2404:x1874206965960960:12345-192.168.203.2@tcp:101:cat.0 Request processed in 202us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383351.730246:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:3.0:1787383351.735946:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383351.736050:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965961088 00000100:00100000:2.0:1787383351.736060:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965961088 00002000:00100000:2.0:1787383351.736108:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff963503fda680 x1874206965961088/t0(0) o3->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:137/0 lens 488/0 e 0 to 0 dl 1787383362 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383351.736120:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503fda680 with x1874206965961088 ext(0->4095) 00002000:00010000:2.0:1787383351.736126:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963503fda680 00000100:00100000:2.0:1787383351.736158:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:2.0:1787383351.736168:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206965961088:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:2.0:1787383351.736341:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206965961088:12345-192.168.203.2@tcp:3:cat.0 Request processed in 173us (403us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787383351.736349:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00002000:00100000:2.0:1787383351.736355:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff963503fda680 x1874206965961088/t0(0) o3->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:137/0 lens 488/4536 e 0 to 0 dl 1787383362 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383351.736368:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503fda680 with x1874206965961088 ext(0->4095) 00002000:00010000:2.0:1787383351.736371:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963503fda680 00000100:00100000:0.0:1787383351.962968:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984905344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383351.963039:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383351.963166:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984905344 00000100:00100000:3.0:1787383351.963173:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984905344 00000100:00100000:3.0:1787383351.963228:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787383351.963238:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1874206984905344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383351.963253:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383351.963261:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984905472:0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383351.963268:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383351.963287:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383351.963310:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1874206984905344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383351.963317:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787383351.963331:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984905472 00000100:00100000:3.0:1787383351.963334:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984905472 00000100:00100000:0.0:1787383351.963345:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984905344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383351.963347:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787383351.963352:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984905472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383351.963361:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383351.963405:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984905472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383351.963426:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787383351.963513:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984905472:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787383351.964212:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383352.478328:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383352.478351:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984905600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383352.478416:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383352.479751:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984905600 00000100:00100000:0.0:1787383352.479801:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984905600 00000100:00100000:0.0:1787383352.479865:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787383352.479875:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984905600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383352.480104:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787383352.480185:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984905600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 311us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383352.480193:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787383352.480285:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984905600:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787383352.989706:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383352.989716:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383352.989736:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984905728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383352.989834:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383352.989892:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984905728 00000100:00100000:2.0:1787383352.989900:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984905728 00000100:00100000:2.0:1787383352.989942:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787383352.989951:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984905728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787383352.989976:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787383352.990016:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984905728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383352.990023:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787383352.990075:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984905728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383352.990812:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984905856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383352.990855:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383352.991365:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984905856 00000100:00100000:0.0:1787383352.991371:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984905856 00000100:00080000:2.0:1787383352.991472:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383352.991554:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787383352.991565:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984905856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383352.991590:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787383352.991636:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984905856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383352.991643:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787383352.991706:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984905856:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787383353.498909:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383353.498918:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383353.498936:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787383353.498943:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787383353.691367:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787383354.011042:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383354.422115:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383354.422163:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383354.422199:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383354.422292:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965961600 00000100:00100000:2.0:1787383354.422303:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965961600 00000100:00100000:2.0:1787383354.422365:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:2.0:1787383354.422374:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965961600:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383354.422460:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965961600:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 86us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383354.422468:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00080000:2.0:1787383354.422490:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383354.424541:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383354.424571:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383354.424634:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965961216 00000100:00100000:2.0:1787383354.424643:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965961216 00000100:00100000:2.0:1787383354.424710:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 382 00000100:00100000:2.0:1787383354.424720:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2402:x1874206965961216:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383354.424807:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2402:x1874206965961216:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383354.424815:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 382 00000100:00100000:3.0:1787383354.438351:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383354.438394:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383354.439555:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965961344 00000100:00100000:0.0:1787383354.439568:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965961344 00000100:00100000:0.0:1787383354.439592:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965961728 00000100:00100000:0.0:1787383354.439595:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965961728 00000100:00100000:1.0:1787383354.439640:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965961856 00000100:00100000:1.0:1787383354.439644:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965961856 00000100:00100000:0.0:1787383354.439661:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00100000:0.0:1787383354.439670:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965961728:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383354.439675:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 291 00000100:00100000:1.0:1787383354.439682:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965961856:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383354.439762:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965961728:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 92us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383354.439783:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00100000:0.0:1787383354.439828:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965961472 00000100:00100000:0.0:1787383354.439832:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965961472 00000100:00100000:0.0:1787383354.439851:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 292 00000100:00100000:0.0:1787383354.439857:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+27:2402:x1874206965961344:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383354.439885:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+27:2402:x1874206965961344:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 28us (17780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383354.439892:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 292 00000100:00100000:0.0:1787383354.439904:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 293 00000100:00100000:0.0:1787383354.439910:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965961472:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383354.439952:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965961472:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 42us (15380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383354.439959:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 293 00000100:00100000:1.0:1787383354.440001:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965961856:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 319us (17801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383354.440008:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 291 00000100:00080000:0.0:1787383354.440014:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383354.440018:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383354.440020:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383354.443594:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965961984 00000100:00100000:2.0:1787383354.443613:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965961984 00000100:00100000:2.0:1787383354.443726:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 294 00000100:00100000:2.0:1787383354.443737:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965961984:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383354.443844:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965961984:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 109us (5448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383354.443852:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 294 00000100:00080000:3.0:1787383354.444577:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787383355.038018:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787383355.042329:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1787383355.547967:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383355.547992:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984905984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787383355.548063:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383355.548129:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984905984 00000100:00100000:1.0:1787383355.548137:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984905984 00000100:00100000:1.0:1787383355.548186:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787383355.548195:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984905984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383355.548227:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383355.548270:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984905984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383355.548289:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787383355.548340:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984905984:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787383356.059349:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787383356.062255:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1787383356.062289:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9636038ade40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787383356.062294:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963503c68700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9636038ad600 00000020:00080000:3.0:1787383356.062297:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963503c68e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96361a5fc200 00000020:00080000:3.0:1787383356.062315:0:6498:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1787383356.062422:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787383356.062488:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1787383356.064725:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ee03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383356.064748:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ee03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383356.064756:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ee03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383356.064762:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383356.064779:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ee03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383356.064786:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ee03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383356.064803:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9635032cdb00) 00010000:00010000:0.0:1787383356.064805:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383356.064810:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ee03 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383356.064817:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532ee03 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383356.065621:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1787383356.065630:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000100:00100000:1.0:1787383356.582114:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984906112:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.582187:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383356.582295:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984906624:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.582338:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383356.582473:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984907136:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.582502:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383356.582529:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984907648:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.582562:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383356.582577:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787383356.582582:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984906496:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.582632:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383356.582644:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984907008:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.582656:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383356.582666:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984907520:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.582676:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383356.582704:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984906624 00000100:00100000:1.0:1787383356.582710:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984906624 00000100:00100000:1.0:1787383356.582759:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787383356.582800:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984906624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383356.582865:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984906368:0@lo:400:kworker.0 00000100:00100000:2.0:1787383356.582901:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383356.582915:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984906880:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.582920:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984906624:12345-0@lo:400:kworker.0 Request processed in 123us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383356.582928:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787383356.582933:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383356.582946:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984906368 00000100:00100000:2.0:1787383356.582949:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984907392:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.582949:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984906368 00000100:00100000:2.0:1787383356.582966:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383356.582966:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787383356.582972:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984906368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383356.582983:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787383356.582989:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984906240:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.582999:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984906368:12345-0@lo:400:kworker.0 Request processed in 27us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383356.583005:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787383356.583007:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383356.583022:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984906752:0@lo:400:kworker.0 00000100:00100000:2.0:1787383356.583040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383356.583043:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984906624:0@lo:400:kworker.0 00000100:00100000:2.0:1787383356.583054:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984907264:0@lo:400:kworker.0 00000100:00100000:2.0:1787383356.583072:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383356.583079:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984907136 00000100:00100000:1.0:1787383356.583082:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984907136 00000100:00100000:2.0:1787383356.583089:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984906368:0@lo:400:kworker.0 00000100:00100000:2.0:1787383356.583107:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984907648 00000100:00100000:1.0:1787383356.583107:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984907008 00000100:00100000:2.0:1787383356.583110:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984907648 00000100:00100000:1.0:1787383356.583110:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984907008 00000100:00100000:1.0:1787383356.583121:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984907520 00000100:00100000:1.0:1787383356.583123:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984907520 00000100:00100000:2.0:1787383356.583126:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787383356.583132:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984907136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.583135:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787383356.583139:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984907008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383356.583173:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984907136:12345-0@lo:400:kworker.0 Request processed in 41us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383356.583173:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984907008:12345-0@lo:400:kworker.0 Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383356.583179:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1787383356.583241:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383356.583246:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383356.583266:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984906496 00000100:00100000:3.0:1787383356.583270:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984906496 00000100:00100000:1.0:1787383356.583277:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787383356.583296:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787383356.583298:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984906880 00000100:00100000:3.0:1787383356.583303:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984906880 00000100:00100000:1.0:1787383356.583307:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984907648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383356.583328:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984907392 00000100:00100000:3.0:1787383356.583332:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984907392 00000100:00100000:3.0:1787383356.583351:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984906240 00000100:00100000:1.0:1787383356.583352:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984907648:12345-0@lo:400:kworker.0 Request processed in 49us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383356.583355:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984906240 00000100:00100000:1.0:1787383356.583363:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787383356.583372:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984906752 00000100:00100000:3.0:1787383356.583375:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984906752 00000100:00100000:0.0:1787383356.583377:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984906112 00000100:00100000:0.0:1787383356.583383:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984906112 00000100:00100000:1.0:1787383356.583385:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787383356.583391:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984907520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383356.583395:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984907264 00000100:00100000:3.0:1787383356.583400:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984907264 00000100:00100000:0.0:1787383356.583418:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1787383356.583427:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984907520:12345-0@lo:400:kworker.0 Request processed in 36us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383356.583427:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636207c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984906112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383356.583431:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787383356.583436:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787383356.583451:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984906496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.583461:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787383356.583472:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984906880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383356.583480:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636207c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3650:x1874206984906112:12345-0@lo:400:kworker.0 Request processed in 55us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383356.583488:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1787383356.583503:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984906496:12345-0@lo:400:kworker.0 Request processed in 54us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383356.583511:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787383356.583521:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984906880:12345-0@lo:400:kworker.0 Request processed in 50us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383356.583525:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787383356.583530:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787383356.583533:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984907392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383356.583537:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787383356.583558:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787383356.583562:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984907392:12345-0@lo:400:kworker.0 Request processed in 31us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383356.583565:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984906752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383356.583568:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787383356.583583:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787383356.583588:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984907264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.583589:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984906752:12345-0@lo:400:kworker.0 Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383356.583595:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787383356.583622:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984906496:0@lo:400:kworker.0 00000100:00100000:0.0:1787383356.583628:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984907264:12345-0@lo:400:kworker.0 Request processed in 40us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383356.583632:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984907008:0@lo:400:kworker.0 00000100:00100000:0.0:1787383356.583634:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787383356.583641:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984907520:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.583650:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787383356.583655:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1787383356.583669:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9636084b5c00, transno 4294967305 00000100:00100000:0.0:1787383356.583674:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984906752:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.583677:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984907648:0@lo:400:kworker.0 00000100:00100000:0.0:1787383356.583682:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984907264:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.583685:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984906112:0@lo:400:kworker.0 00000100:00100000:1.0:1787383356.583693:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967314 gen 2 00010000:00080000:0.0:1787383356.583693:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635045b8000 x1874206984906880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787383356.583702:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967314 committed transno 4294967314 00000100:00100000:0.0:1787383356.583702:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984906880:0@lo:400:kworker.0 00010000:00080000:0.0:1787383356.583710:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635045bb800 x1874206984907392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383356.583712:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984907136:0@lo:400:kworker.0 00000100:00100000:0.0:1787383356.583723:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984907392:0@lo:400:kworker.0 00000100:00080000:0.0:1787383356.583781:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383356.583785:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383356.584952:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984906240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383356.585022:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984906240:12345-0@lo:400:kworker.0 Request processed in 83us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383356.585029:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787383356.586719:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984906240:0@lo:400:kworker.0 00000100:00100000:2.0:1787383357.085403:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984907776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383357.085486:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383357.085557:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984907776 00000100:00100000:2.0:1787383357.085574:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984907776 00000100:00100000:2.0:1787383357.085622:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787383357.085637:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984907776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383357.085668:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383357.086614:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984907904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383357.086662:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383357.086992:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984907904 00000100:00100000:3.0:1787383357.086999:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984907904 00000100:00100000:3.0:1787383357.087034:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787383357.087044:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984907904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383357.087063:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383357.087113:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984907904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383357.087120:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:0.0:1787383357.087155:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383357.088610:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984907904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383357.089374:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984907776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3736us (3886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383357.089383:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787383357.095124:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984907776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383357.595182:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984908032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383357.595253:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383357.595477:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984908032 00000100:00100000:3.0:1787383357.595485:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984908032 00000100:00100000:1.0:1787383357.595998:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787383357.596010:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984908032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383357.596044:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787383357.596413:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984908032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 405us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383357.596421:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787383357.596495:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984908032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383357.748382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383357.749203:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965962112 00000100:00100000:2.0:1787383357.749218:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965962112 00000100:00100000:2.0:1787383357.749301:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 147 00000100:00100000:2.0:1787383357.749313:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+13:11090:x1874206965962112:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787383357.749427:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+13:11090:x1874206965962112:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 Request processed in 118us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383357.749434:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 147 00000100:00080000:0.0:1787383357.750388:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383357.751868:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383357.752026:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965962240 00000100:00100000:0.0:1787383357.752035:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965962240 00000100:00100000:0.0:1787383357.752156:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 148 00000100:00100000:0.0:1787383357.752168:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:11090:x1874206965962240:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787383357.752258:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:11090:x1874206965962240:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 Request processed in 93us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383357.752265:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 148 00000100:00080000:3.0:1787383357.762994:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383357.768914:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383357.769065:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965962496 00000100:00100000:2.0:1787383357.769080:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965962496 00000100:00100000:2.0:1787383357.769159:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:2.0:1787383357.769172:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+13:11090:x1874206965962496:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787383357.769408:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+14:11090:x1874206965962496:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 239us (506us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787383357.769416:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:2.0:1787383358.078321:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383358.078449:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965962624 00000100:00100000:3.0:1787383358.078461:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965962624 00000100:00100000:3.0:1787383358.078564:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 149 00000100:00100000:3.0:1787383358.078576:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:11888:x1874206965962624:12345-192.168.203.2@tcp:101:lsof.0 00010000:00010000:3.0:1787383358.078605:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383358.078634:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ee8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028bc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383358.078718:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383358.078744:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383358.078761:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383358.078873:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787383358.078877:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383358.078926:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383358.078956:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532ee8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028bc expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383358.078978:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028bc expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383358.078988:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628fc9800) 00010000:00010000:3.0:1787383358.078991:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383358.079013:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030a00, rc 0) 00000100:00100000:3.0:1787383358.079098:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:11888:x1874206965962624:12345-192.168.203.2@tcp:101:lsof.0 Request processed in 524us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383358.079106:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 149 00000100:00080000:0.0:1787383358.079193:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787383358.107162:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383358.108674:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984908160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383358.108796:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383358.108895:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984908160 00000100:00100000:0.0:1787383358.108904:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984908160 00000100:00100000:0.0:1787383358.108970:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787383358.108980:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984908160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787383358.109018:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787383358.109068:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984908160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383358.109075:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1787383358.109112:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383358.109172:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984908160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383358.110650:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350441a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984908288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383358.110711:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383358.111611:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984908288 00000100:00100000:2.0:1787383358.111623:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984908288 00000100:00100000:2.0:1787383358.111697:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787383358.111708:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984908288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383358.111943:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787383358.112652:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984908288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 942us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383358.112664:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1787383358.112947:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383358.112958:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350441a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984908288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787383359.134338:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383359.550620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383359.550657:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383359.550688:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383359.550730:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383359.550752:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383359.550800:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383359.550831:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383359.550870:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965963264 00000100:00100000:2.0:1787383359.550890:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965962752 00000100:00100000:0.0:1787383359.550890:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965963264 00000100:00100000:2.0:1787383359.550905:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965962752 00000100:00100000:0.0:1787383359.550969:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965963136 00000100:00100000:0.0:1787383359.550975:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965963136 00000100:00100000:2.0:1787383359.550985:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 384 00000100:00100000:2.0:1787383359.551001:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965962752:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383359.551016:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:0.0:1787383359.551030:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965963264:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383359.551110:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965962752:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 110us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383359.551121:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 384 00000100:00100000:1.0:1787383359.551157:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965963008 00000100:00100000:1.0:1787383359.551164:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965963008 00000100:00100000:2.0:1787383359.551190:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 145 00000100:00100000:2.0:1787383359.551203:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965963136:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383359.551210:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965963520 00000100:00100000:1.0:1787383359.551214:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965963520 00000100:00100000:1.0:1787383359.551238:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965962880 00000100:00100000:1.0:1787383359.551241:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965962880 00000100:00100000:1.0:1787383359.551333:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965963392 00000100:00100000:1.0:1787383359.551337:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965963392 00000100:00100000:1.0:1787383359.551354:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 301 00000100:00100000:1.0:1787383359.551361:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965963008:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383359.554520:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965963264:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 3482us (3818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383359.554535:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00080000:0.0:1787383359.554587:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383359.554593:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383359.554597:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383359.554600:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383359.554617:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 302 00000100:00100000:0.0:1787383359.554631:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965963520:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383359.554782:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965963520:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 140us (4035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383359.554807:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 302 00000100:00100000:0.0:1787383359.554825:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 303 00000100:00100000:0.0:1787383359.554833:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+14:2404:x1874206965962880:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383359.554865:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+14:2404:x1874206965962880:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 33us (4113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383359.555224:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 303 00000100:00100000:0.0:1787383359.555240:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 304 00000100:00100000:0.0:1787383359.555249:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2404:x1874206965963392:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383359.555278:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2404:x1874206965963392:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 31us (4448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383359.555284:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 304 00000100:00100000:2.0:1787383359.559498:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965963136:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 7827us (8225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383359.559522:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 145 00000100:00100000:1.0:1787383359.561149:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965963008:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 9774us (10477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383359.561174:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 301 00010000:00010000:0.0:1787383360.158446:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383360.675630:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984908416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383360.675762:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383360.675949:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984908416 00000100:00100000:0.0:1787383360.675958:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984908416 00000100:00100000:0.0:1787383360.676017:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787383360.676034:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984908416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383360.676079:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787383360.676155:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984908416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383360.676162:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787383360.676208:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984908416:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1787383360.778062:0:14458:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:22:39 (1787383359) 00010000:00010000:0.0:1787383361.178969:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383361.691310:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984908544:0@lo:400:kworker.0 00000100:00100000:2.0:1787383361.691382:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383361.691959:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984908544 00000100:00100000:0.0:1787383361.691968:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984908544 00000100:00100000:0.0:1787383361.692030:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1787383361.692038:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984908544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383361.696264:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984908672:0@lo:400:kworker.0 00000100:00100000:1.0:1787383361.696727:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383361.696820:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984908672 00000100:00100000:1.0:1787383361.696829:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984908672 00000100:00100000:1.0:1787383361.696891:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787383361.696900:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984908672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383361.696953:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984908672:12345-0@lo:400:kworker.0 Request processed in 54us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383361.696961:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787383361.697002:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984908672:0@lo:400:kworker.0 00000001:00080000:1.0:1787383361.698336:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1787383361.698349:0:6498:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787383361.698365:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787383361.698372:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787383361.699017:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984908544:12345-0@lo:400:kworker.0 Request processed in 6975us (7631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383361.699028:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1787383361.699145:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984908928:0@lo:400:kworker.0 00000100:00100000:1.0:1787383361.699146:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984908800:0@lo:400:kworker.0 00000100:00100000:3.0:1787383361.699204:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383361.699210:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383361.699234:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984909312:0@lo:400:kworker.0 00000100:00100000:1.0:1787383361.699277:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984908800 00000100:00100000:1.0:1787383361.699284:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984908800 00000100:00100000:1.0:1787383361.699318:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787383361.699326:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984908800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383361.699337:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984909440:0@lo:400:kworker.0 00000100:00100000:1.0:1787383361.699381:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984908800:12345-0@lo:400:kworker.0 Request processed in 55us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383361.699387:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787383361.699416:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984909184:0@lo:400:kworker.0 00000100:00100000:3.0:1787383361.699423:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383361.699446:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383361.699450:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984909952:0@lo:400:kworker.0 00000100:00100000:3.0:1787383361.699482:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383361.699515:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984909440 00000100:00100000:3.0:1787383361.699519:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984909440 00000100:00100000:3.0:1787383361.699556:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984909952 00000100:00100000:3.0:1787383361.699559:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984909952 00000100:00100000:3.0:1787383361.699580:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787383361.699587:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984909440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383361.699622:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984909440:12345-0@lo:400:kworker.0 Request processed in 35us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383361.699628:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787383361.699640:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787383361.699646:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984909952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383361.699671:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984909952:12345-0@lo:400:kworker.0 Request processed in 26us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383361.699684:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1787383361.699861:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383361.699866:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383361.699893:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984909440:0@lo:400:kworker.0 00000100:00100000:3.0:1787383361.699903:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984909952:0@lo:400:kworker.0 00000100:00100000:2.0:1787383361.699993:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984908544:0@lo:400:kworker.0 00000100:00100000:2.0:1787383361.700020:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984909056:0@lo:400:kworker.0 00000100:00100000:2.0:1787383361.700048:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383361.700116:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984909568:0@lo:400:kworker.0 00000100:00100000:2.0:1787383361.700137:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383361.700152:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984910080:0@lo:400:kworker.0 00000100:00100000:2.0:1787383361.700171:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383361.700196:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984909568 00000100:00100000:2.0:1787383361.700199:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984909568 00000100:00100000:2.0:1787383361.700302:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984910080 00000100:00100000:2.0:1787383361.700306:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984910080 00000100:00100000:2.0:1787383361.700322:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787383361.700327:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984909568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383361.700360:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984909568:12345-0@lo:400:kworker.0 Request processed in 32us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383361.700366:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787383361.700377:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787383361.700382:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984910080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383361.700403:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984910080:12345-0@lo:400:kworker.0 Request processed in 21us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383361.700408:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1787383361.700420:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383361.700422:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383361.700453:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984909568:0@lo:400:kworker.0 00000100:00100000:2.0:1787383361.700462:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984910080:0@lo:400:kworker.0 00000100:00100000:3.0:1787383361.700619:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984909056 00000100:00100000:3.0:1787383361.700627:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984909056 00000100:00100000:3.0:1787383361.700881:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787383361.700891:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984909056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383361.700928:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984909696:0@lo:400:kworker.0 00000100:00100000:3.0:1787383361.700944:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984909056:12345-0@lo:400:kworker.0 Request processed in 54us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383361.700953:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787383361.700964:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383361.701150:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984909056:0@lo:400:kworker.0 00000100:00100000:0.0:1787383361.701214:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984908928 00000100:00100000:0.0:1787383361.701219:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984908928 00000100:00100000:0.0:1787383361.701260:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984909184 00000100:00100000:0.0:1787383361.701264:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984909184 00000100:00100000:0.0:1787383361.701291:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787383361.701299:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984908928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383361.701342:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984909696 00000100:00100000:3.0:1787383361.701347:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984909696 00000100:00100000:0.0:1787383361.701352:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984908928:12345-0@lo:400:kworker.0 Request processed in 55us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383361.701358:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787383361.701371:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787383361.701375:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787383361.701378:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984909184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383361.701380:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984909696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383361.701413:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984909696:12345-0@lo:400:kworker.0 Request processed in 30us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383361.701419:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:2.0:1787383361.701490:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383361.701502:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383361.701562:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984909824:0@lo:400:kworker.0 00000100:00100000:2.0:1787383361.701587:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383361.701618:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984908800:0@lo:400:kworker.0 00000100:00100000:2.0:1787383361.701638:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984909312 00000100:00100000:2.0:1787383361.701641:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984909312 00000100:00100000:2.0:1787383361.701667:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984909824 00000100:00100000:2.0:1787383361.701670:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984909824 00000100:00100000:2.0:1787383361.701846:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787383361.701856:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984909312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383361.701900:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984909312:12345-0@lo:400:kworker.0 Request processed in 46us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383361.701907:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787383361.701919:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787383361.701928:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984909824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383361.701956:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984909824:12345-0@lo:400:kworker.0 Request processed in 32us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383361.701962:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:2.0:1787383361.701976:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787383361.701996:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f35180 x1874206984909312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383361.702006:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984909312:0@lo:400:kworker.0 00000100:00100000:3.0:1787383361.702076:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984909184:12345-0@lo:400:kworker.0 Request processed in 698us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383361.702083:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787383361.702115:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984909184:0@lo:400:kworker.0 00000100:00100000:3.0:1787383361.702116:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984908928:0@lo:400:kworker.0 00000100:00100000:1.0:1787383361.702143:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984909696:0@lo:400:kworker.0 00010000:00080000:2.0:1787383361.705146:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f35880 x1874206984909824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383361.705183:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984909824:0@lo:400:kworker.0 00000100:00100000:3.0:1787383362.202957:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383362.202979:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984910336:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787383362.202996:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383362.203043:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383362.203165:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984910336 00000100:00100000:0.0:1787383362.203173:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984910336 00000100:00100000:0.0:1787383362.203224:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787383362.203234:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984910336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383362.203261:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383362.203306:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984910336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383362.203329:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787383362.203374:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984910336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383362.203479:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984910208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383362.203509:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383362.203586:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984910208 00000100:00100000:0.0:1787383362.203590:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984910208 00000100:00100000:0.0:1787383362.203620:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787383362.203627:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984910208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383362.203637:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383362.203668:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984910208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383362.203675:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787383362.203710:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984910208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383362.252454:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383362.252552:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965963776 00000100:00100000:2.0:1787383362.252560:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965963776 00000100:00100000:2.0:1787383362.252660:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 150 00000100:00100000:2.0:1787383362.252671:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+13:12155:x1874206965963776:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383362.252691:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383362.252762:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532ee9d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028c3 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.252860:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532eea4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.252883:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532eea4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.252895:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532eea4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.252923:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eeab lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.252931:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eeab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.252938:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eeab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253024:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532eeb2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253049:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532eeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253056:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532eeb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383362.253067:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787383362.253147:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532eea4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253155:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532eea4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253161:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532eea4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253167:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383362.253171:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532eea4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253178:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532eea4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253190:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff963628fc9000) 00010000:00010000:2.0:1787383362.253193:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383362.253196:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532eea4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253202:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532eea4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253215:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eeab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253227:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eeab lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253232:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eeab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253236:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383362.253239:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eeab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253245:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eeab lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253252:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9635032cd200) 00010000:00010000:2.0:1787383362.253255:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383362.253257:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eeab lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.253263:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532eeab lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.254073:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532ee9d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028c3 expref: 16 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.254091:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532eeb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028c3 expref: 15 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.254099:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628fc9400) 00010000:00010000:2.0:1787383362.254102:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383362.254113:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9800, rc 0) 00000100:00100000:2.0:1787383362.254183:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+15:12155:x1874206965963776:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 1514us (1737us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787383362.254192:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 150 00000100:00080000:0.0:1787383362.257223:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383362.266257:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383362.266365:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965963904 00000100:00100000:2.0:1787383362.266383:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965963904 00000100:00100000:2.0:1787383362.266456:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 151 00000100:00100000:2.0:1787383362.266467:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+15:12155:x1874206965963904:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787383362.266581:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+15:12155:x1874206965963904:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 116us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383362.266589:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 151 00000100:00100000:3.0:1787383362.267191:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383362.267271:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965964032 00000100:00100000:2.0:1787383362.267276:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965964032 00000100:00100000:2.0:1787383362.267316:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:2.0:1787383362.267324:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636420d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+15:2404:x1874206965964032:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383362.267334:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383362.267356:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532eeb2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028c3 expref: 15 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383362.267375:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628fc9400) 00010000:00010000:2.0:1787383362.267380:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383362.267415:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636420d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+14:2404:x1874206965964032:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 91us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383362.267422:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:0.0:1787383362.269823:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383362.269905:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965964160 00000100:00100000:2.0:1787383362.269913:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965964160 00000100:00100000:2.0:1787383362.269980:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 152 00000100:00100000:2.0:1787383362.270002:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:12155:x1874206965964160:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787383362.270085:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:12155:x1874206965964160:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383362.270093:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 152 00000100:00080000:0.0:1787383362.270147:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383362.716292:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984910464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383362.716379:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383362.716524:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984910464 00000100:00100000:3.0:1787383362.716532:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984910464 00000100:00100000:3.0:1787383362.716610:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787383362.716628:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984910464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787383362.717630:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787383362.717908:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984910464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1283us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383362.717924:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787383362.718114:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984910464:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1787383362.718631:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383362.718636:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383362.720026:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787383362.720055:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787383362.912100:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787383363.227935:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383363.228092:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984910592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383363.229255:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984910720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383363.229320:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383363.230497:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383363.230783:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984910720 00000100:00100000:3.0:1787383363.230793:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984910720 00000100:00100000:3.0:1787383363.230896:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984910592 00000100:00100000:3.0:1787383363.230900:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984910592 00000100:00100000:1.0:1787383363.230960:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787383363.230971:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984910720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383363.231002:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787383363.231059:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984910720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383363.231067:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787383363.231128:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984910720:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787383363.231357:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383363.231455:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787383363.231463:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984910592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787383363.231475:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787383363.231561:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984910592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383363.231568:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787383363.231644:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984910592:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1787383363.739450:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383363.739466:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383363.739627:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787383363.739635:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787383363.934096:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787383364.160328:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383364.160425:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965964288 00000100:00100000:0.0:1787383364.160439:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965964288 00000100:00100000:0.0:1787383364.160655:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 153 00000100:00100000:0.0:1787383364.160666:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+14:12197:x1874206965964288:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383364.160699:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383364.160792:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532eec0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028ca expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.160854:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eec7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.160880:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eec7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.160891:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eec7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.160910:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532eece lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.160917:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532eece lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.160924:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532eece lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.160968:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eec7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.160975:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eec7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.160982:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eec7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.160994:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383364.160998:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eec7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.161006:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eec7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.161018:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628fc9800) 00010000:00010000:0.0:1787383364.161021:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383364.161025:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.161031:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.161041:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532eece lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.161047:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532eece lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.161053:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532eece lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.161058:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383364.161060:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532eece lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.161066:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532eece lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.161085:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff963602a66600) 00010000:00010000:0.0:1787383364.161087:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383364.161090:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532eece lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.161097:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532eece lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.161125:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532eec0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ca expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.161135:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628fc9800) 00010000:00010000:0.0:1787383364.161138:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383364.161141:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532eec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ca expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.161149:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16000, rc 0) 00000100:00100000:0.0:1787383364.161206:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+14:12197:x1874206965964288:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 542us (887us total) trans 0 rc 301/301 00000100:00100000:0.0:1787383364.161214:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 153 00000100:00080000:1.0:1787383364.161459:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383364.174957:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383364.174991:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965964544 00000100:00100000:3.0:1787383364.175006:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965964544 00000100:00100000:3.0:1787383364.175131:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 154 00000100:00100000:3.0:1787383364.175141:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+14:12197:x1874206965964544:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:3.0:1787383364.175193:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383364.175218:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532e814 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026ee expref: 14 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.175234:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628fc9800) 00010000:00010000:3.0:1787383364.175239:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383364.175295:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.175310:0:9499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028bc expref: 5 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.175319:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.175351:0:9499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028bc expref: 5 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.175363:0:9499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028bc expref: 5 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383364.175376:0:9499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1874206984910848:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383364.175457:0:9499:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503655840 going to sleep for 11 seconds 00000100:00100000:3.0:1787383364.180296:0:9499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1874206984910848:192.168.203.2@tcp:104: 00010000:00010000:3.0:1787383364.180325:0:9499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383364.186423:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383364.186898:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965964672 00000100:00100000:2.0:1787383364.186908:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965964672 00010000:00010000:2.0:1787383364.186957:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028bc expref: 6 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383364.187153:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 78 00000100:00100000:2.0:1787383364.187163:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2402:x1874206965964672:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383364.187178:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383364.187184:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028bc expref: 6 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.187198:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028bc expref: 6 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.187220:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532ee96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028bc expref: 6 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.187234:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628fc9800) 00010000:00010000:2.0:1787383364.187239:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.187262:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.187270:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.187299:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383364.187354:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965964672:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 192us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383364.187362:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 78 00000100:00080000:1.0:1787383364.187409:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787383364.187447:0:9499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.187455:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.187478:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532eedc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.187488:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532eedc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.187496:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532eedc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.189561:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532eee3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.189581:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532eee3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.189591:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532eee3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383364.189609:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c874174a reply state 00000000a57482d5 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532eee3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.189692:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532eee3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.190003:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:3.0:1787383364.190011:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787383364.190015:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787383364.190021:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787383364.190031:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.190037:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.190113:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.190120:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383364.190125:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.190132:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.190143:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628fc9800) 00010000:00010000:3.0:1787383364.190145:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383364.190149:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.190155:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532eed5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383364.190172:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c874174a reply state 00000000a57482d5 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532eedc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.190180:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532eedc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.190196:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96363d897500) 00010000:00010000:3.0:1787383364.190198:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787383364.190200:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787383364.190317:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+15:12197:x1874206965964544:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 15174us (15364us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787383364.190326:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 154 00010000:00010000:0.0:1787383364.253382:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383364.290100:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383364.290378:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965964800 00000100:00100000:2.0:1787383364.290388:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965964800 00000100:00100000:2.0:1787383364.290450:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 155 00000100:00100000:2.0:1787383364.290613:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+15:12205:x1874206965964800:12345-192.168.203.2@tcp:101:lctl.0 00010000:00010000:2.0:1787383364.290939:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383364.290965:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532eeea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028d1 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.291028:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532eef1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.291112:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532eef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.291194:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532eef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383364.291242:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787383364.291246:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383364.291283:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532eef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.291307:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532eeea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028d1 expref: 17 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.291325:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532eef1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028d1 expref: 16 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.291333:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635032cd200) 00010000:00010000:2.0:1787383364.291336:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383364.291340:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8200, rc 0) 00000100:00100000:2.0:1787383364.291465:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+16:12205:x1874206965964800:12345-192.168.203.2@tcp:101:lctl.0 Request processed in 856us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383364.291473:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 155 00000100:00100000:2.0:1787383364.387229:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383364.387329:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965964928 00000100:00100000:0.0:1787383364.387338:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965964928 00000100:00100000:0.0:1787383364.387462:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 156 00000100:00100000:0.0:1787383364.387473:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+16:12211:x1874206965964928:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1787383364.387607:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383364.387936:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532eef8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028d8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388016:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eeff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388030:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eeff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388041:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eeff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388052:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ef06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388060:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ef06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388066:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ef06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388150:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ef0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388159:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ef0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388167:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ef0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383364.388203:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787383364.388207:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383364.388226:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ef0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388247:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eeff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388253:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eeff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388259:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eeff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388264:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383364.388268:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eeff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388275:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eeff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388287:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635032cd200) 00010000:00010000:0.0:1787383364.388290:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383364.388294:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eeff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388300:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532eeff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388312:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ef06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388318:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ef06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388323:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ef06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388334:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383364.388338:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ef06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388344:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ef06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388352:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96363d897500) 00010000:00010000:0.0:1787383364.388354:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383364.388357:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ef06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388363:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532ef06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388569:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532eef8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028d8 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388583:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ef0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028d8 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.388590:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:0.0:1787383364.388592:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787383364.388595:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17200, rc 0) 00000100:00100000:0.0:1787383364.389029:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+17:12211:x1874206965964928:12345-192.168.203.2@tcp:101:bash.0 Request processed in 1556us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383364.389038:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 156 00000100:00100000:0.0:1787383364.392954:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383364.393756:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965965184 00000100:00100000:3.0:1787383364.393797:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965965184 00000100:00100000:3.0:1787383364.393853:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 157 00000100:00100000:3.0:1787383364.393863:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+17:12211:x1874206965965184:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1787383364.393884:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383364.393904:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ef14 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028df expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.394014:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef1b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.394028:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.394038:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.394106:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ef22 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.394114:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ef22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.394133:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ef22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787383364.394509:0:9499:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787383364.395448:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ef29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.395462:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ef29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.395473:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ef29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.395507:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.395515:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef1b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.395523:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef1b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.395529:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383364.395533:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef1b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.395540:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef1b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.395551:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:3.0:1787383364.395554:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383364.395577:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef1b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.395583:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef1b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383364.395599:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000acb81fc9 reply state 00000000f89bc9bf transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ef22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.395609:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ef22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.395615:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96363d897300) 00010000:00010000:3.0:1787383364.395617:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787383364.395620:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787383364.395652:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ef14 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028df expref: 20 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.395667:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ef29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028df expref: 19 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.395674:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96363d897b00) 00010000:00010000:3.0:1787383364.395688:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383364.395691:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030000, rc 0) 00000100:00100000:3.0:1787383364.395778:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+20:12211:x1874206965965184:12345-192.168.203.2@tcp:101:bash.0 Request processed in 1902us (2818us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1787383364.395789:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 157 00000100:00100000:1.0:1787383364.401178:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383364.401251:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965965312 00000100:00100000:2.0:1787383364.401261:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965965312 00000100:00100000:2.0:1787383364.401345:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:2.0:1787383364.401355:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965965312:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1787383364.401374:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383364.401395:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ef37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028e6 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383364.401430:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383364.401447:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1787383364.401451:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383364.401462:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ef37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028e6 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787383364.401463:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787383364.401941:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ef37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028e6 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.401958:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8400, rc 0) 00000100:00100000:2.0:1787383364.402056:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965965312:12345-192.168.203.2@tcp:101:bash.0 Request processed in 702us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383364.402063:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:2.0:1787383364.405599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383364.405704:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965965440 00000100:00100000:3.0:1787383364.405714:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965965440 00000100:00100000:3.0:1787383364.405818:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:3.0:1787383364.405828:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:12211:x1874206965965440:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1787383364.405857:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383364.405874:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028ed expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.405904:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ef37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028e6 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.405913:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383364.405917:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383364.405922:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.405956:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ef37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028e6 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.405969:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ef37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028e6 expref: 7 pid: 8435 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383364.405982:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874206984910976:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383364.406446:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503655c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383364.413005:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874206984910976:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383364.413040:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.413060:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030400, rc 0) 00000100:00100000:2.0:1787383364.413117:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:12211:x1874206965965440:12345-192.168.203.2@tcp:101:bash.0 Request processed in 7289us (7641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383364.413126:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:0.0:1787383364.414978:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383364.415067:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965965568 00000100:00100000:2.0:1787383364.415075:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965965568 00010000:00010000:2.0:1787383364.415112:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ef37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028e6 expref: 7 pid: 8435 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383364.415151:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 79 00000100:00100000:2.0:1787383364.415160:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206965965568:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383364.415174:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383364.415207:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ef37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028e6 expref: 7 pid: 8435 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.415221:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ef37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028e6 expref: 7 pid: 8435 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.415243:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532ef37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028e6 expref: 7 pid: 8435 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.415260:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383364.415264:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383364.415272:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.415281:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.415316:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383364.415331:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1874206984911104:192.168.203.2@tcp:105: 00000100:00100000:2.0:1787383364.415518:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361afd79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383364.418465:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1874206984911104:192.168.203.2@tcp:105: 00010000:00010000:2.0:1787383364.418491:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383364.418556:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2401:x1874206965965568:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 3396us (3583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383364.418584:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 79 00000100:00100000:0.0:1787383364.422115:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383364.422198:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965965824 00000100:00100000:2.0:1787383364.422208:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965965824 00000100:00100000:2.0:1787383364.422262:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:2.0:1787383364.422271:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+20:12211:x1874206965965824:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:2.0:1787383364.422579:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+21:12211:x1874206965965824:12345-192.168.203.2@tcp:35:bash.0 Request processed in 308us (472us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787383364.422587:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:0.0:1787383364.493074:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383364.493158:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965966080 00000100:00100000:2.0:1787383364.493169:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965966080 00000100:00100000:2.0:1787383364.493228:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 158 00000100:00100000:2.0:1787383364.493238:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+21:12221:x1874206965966080:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1787383364.493261:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383364.493280:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028f4 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383364.493373:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787383364.493475:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028f4 expref: 23 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.493490:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635032cd200) 00010000:00010000:2.0:1787383364.493493:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383364.493499:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028f4 expref: 23 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.493513:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8400, rc 0) 00000100:00100000:2.0:1787383364.493591:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+22:12221:x1874206965966080:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 354us (525us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1787383364.493598:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 158 00000100:00100000:0.0:1787383364.511366:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383364.511668:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965966336 00000100:00100000:2.0:1787383364.511687:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965966336 00000100:00100000:2.0:1787383364.511801:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:2.0:1787383364.511812:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+22:12221:x1874206965966336:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1787383364.512152:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+23:12221:x1874206965966336:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 342us (793us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787383364.512160:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:1.0:1787383364.580129:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383364.580219:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965966464 00000100:00100000:0.0:1787383364.580229:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965966464 00000100:00100000:0.0:1787383364.580399:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 159 00000100:00100000:0.0:1787383364.580410:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+23:12227:x1874206965966464:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383364.580436:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383364.580457:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532ef53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34028fb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.580521:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532ef5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.580535:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532ef5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.580546:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532ef5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383364.580586:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787383364.580590:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383364.580607:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532ef5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.580632:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532ef53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028fb expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.580649:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532ef5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028fb expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.580667:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:0.0:1787383364.580670:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383364.580673:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17e00, rc 0) 00000100:00100000:0.0:1787383364.580748:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+24:12227:x1874206965966464:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 339us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383364.580756:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 159 00000100:00100000:0.0:1787383364.584895:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383364.584960:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965966720 00000100:00100000:3.0:1787383364.584971:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965966720 00000100:00100000:3.0:1787383364.585032:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 160 00000100:00100000:3.0:1787383364.585042:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+24:12227:x1874206965966720:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383364.585062:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383364.585082:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ef61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402902 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.585214:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.585228:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.585239:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383364.585250:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787383364.585352:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532ef61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402902 expref: 27 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.585371:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402902 expref: 26 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.585391:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96363d897b00) 00010000:00010000:3.0:1787383364.585394:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383364.585397:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600031200, rc 0) 00000100:00100000:3.0:1787383364.585456:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+26:12227:x1874206965966720:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 415us (569us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1787383364.585463:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 160 00000100:00100000:1.0:1787383364.589115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383364.589150:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383364.589173:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965966976 00000100:00100000:0.0:1787383364.589182:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965966976 00000100:00100000:3.0:1787383364.589206:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965967104 00000100:00100000:3.0:1787383364.589212:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965967104 00000100:00100000:3.0:1787383364.589271:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:3.0:1787383364.589281:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+27:2402:x1874206965967104:12345-192.168.203.2@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787383364.589291:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 161 00010000:00010000:3.0:1787383364.589298:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787383364.589303:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+27:12227:x1874206965966976:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383364.589324:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383364.589340:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532ef68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402902 expref: 27 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.589341:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532ef76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402909 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.589380:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96363d897b00) 00010000:00010000:3.0:1787383364.589386:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383364.589443:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+27:2402:x1874206965967104:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 162us (290us total) trans 0 rc 0/0 00010000:00010000:0.0:1787383364.589450:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532ef7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383364.589452:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00010000:00010000:0.0:1787383364.589476:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532ef7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.589497:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532ef7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383364.589513:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787383364.589666:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532ef76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402909 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.589692:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532ef7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402909 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.589700:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96363d897b00) 00010000:00010000:1.0:1787383364.589710:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787383364.589713:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17000, rc 0) 00000100:00100000:1.0:1787383364.589814:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+27:12227:x1874206965966976:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 438us (627us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1787383364.589822:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 161 00000100:00100000:1.0:1787383364.597950:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383364.598089:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965967232 00000100:00100000:3.0:1787383364.598099:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965967232 00000100:00100000:3.0:1787383364.598168:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:3.0:1787383364.598178:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2402:x1874206965967232:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:3.0:1787383364.598221:0:8914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.598239:0:8914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.598248:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383364.598252:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383364.598257:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.598293:0:8914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.598307:0:8914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 6 pid: 8436 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383364.598337:0:8914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8914:1874206984911232:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383364.598443:0:8914:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503655000 going to sleep for 11 seconds 00000100:00100000:2.0:1787383364.600543:0:8914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8914:1874206984911232:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383364.600646:0:8914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383364.601475:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383364.601810:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965967360 00000100:00100000:2.0:1787383364.601818:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965967360 00002000:00100000:2.0:1787383364.601868:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff963503f6ad80 x1874206965967360/t0(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:150/0 lens 504/0 e 0 to 0 dl 1787383375 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383364.601878:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503f6ad80 with x1874206965967360 ext(0->12) 00010000:00010000:2.0:1787383364.601888:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 7 pid: 8436 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.601903:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 7 pid: 8436 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383364.601911:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff963503f6ad80 00000100:00100000:2.0:1787383364.601958:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:2.0:1787383364.601967:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206965967360:12345-192.168.203.2@tcp:4:lfs.0 00000100:00100000:2.0:1787383364.604023:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2401:x1874206965967360:12345-192.168.203.2@tcp:4:lfs.0 Request processed in 2049us (2542us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787383364.604036:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00002000:00100000:2.0:1787383364.604048:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff963503f6ad80 x1874206965967360/t4294967306(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:150/0 lens 504/448 e 0 to 0 dl 1787383375 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383364.604057:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503f6ad80 with x1874206965967360 ext(0->12) 00010000:00010000:2.0:1787383364.604067:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 9 pid: 8436 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.604083:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 9 pid: 8436 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383364.604090:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff963503f6ad80 00000100:00100000:3.0:1787383364.610120:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383364.610288:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965967488 00000100:00100000:2.0:1787383364.610299:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965967488 00010000:00010000:2.0:1787383364.610338:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 9 pid: 8436 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383364.610389:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 80 00000100:00100000:2.0:1787383364.610399:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2403:x1874206965967488:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383364.610413:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787383364.610430:0:7461:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787383364.610433:0:7461:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787383364 00002000:00010000:2.0:1787383364.610448:0:7461:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787383364 00002000:00010000:2.0:1787383364.610451:0:7461:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787383364 00002000:00010000:2.0:1787383364.610453:0:7461:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787383364.610461:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 9 pid: 8436 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.610476:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 9 pid: 8436 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.610500:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532ef3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ed expref: 9 pid: 8436 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.610517:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383364.610521:0:7461:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383364.610527:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.610537:0:7461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.610744:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383364.610849:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2403:x1874206965967488:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 451us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383364.610859:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 80 00010000:00010000:3.0:1787383364.612899:0:8914:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.612917:0:8914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.612946:0:8914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.612954:0:8914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.612963:0:8914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.612970:0:8914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383364.612974:0:8914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.612983:0:8914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.613022:0:8914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.613030:0:8914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532ef8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383364.613165:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965967232:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 14986us (15221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383364.613175:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:3.0:1787383364.616377:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383364.616469:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965967744 00000100:00100000:2.0:1787383364.616480:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965967744 00000100:00100000:2.0:1787383364.616543:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:2.0:1787383364.616552:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+27:12227:x1874206965967744:12345-192.168.203.2@tcp:35:lfs.0 00000004:00010000:2.0:1787383364.616639:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532ef7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402909 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383364.617106:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1787383364.617144:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787383364.617431:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1787383364.617466:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.617481:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ef29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028df expref: 31 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.617491:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.617525:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ef29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028df expref: 31 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.617540:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ef29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028df expref: 31 pid: 9499 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383364.617553:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874206984911360:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383364.617702:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91180 going to sleep for 11 seconds 00000100:00100000:0.0:1787383364.620578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383364.620865:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965967872 00000100:00100000:3.0:1787383364.620875:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965967872 00010000:00010000:3.0:1787383364.620913:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ef29 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028df expref: 32 pid: 9499 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383364.620954:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 81 00000100:00100000:3.0:1787383364.620964:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+32:2402:x1874206965967872:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383364.620978:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383364.620995:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ef29 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028df expref: 32 pid: 9499 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.621009:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ef29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028df expref: 32 pid: 9499 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.621032:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96363d897b00) 00010000:00010000:3.0:1787383364.621051:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.621061:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.621068:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383364.621088:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383364.621146:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+32:2402:x1874206965967872:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 182us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383364.621154:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 81 00010000:00010000:2.0:1787383364.622361:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532ef29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028df expref: 31 pid: 9499 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383364.622437:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6523:1874206984911360:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383364.622459:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.622480:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.622486:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383364.622716:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1787383364.622946:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1787383364.623046:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874206984911488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787383364.623103:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383364.623135:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361afd79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383364.623205:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984911488 00000100:00100000:3.0:1787383364.623211:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984911488 00000100:00100000:3.0:1787383364.623272:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787383364.623280:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1874206984911488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787383364.623354:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1874206984911488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383364.623362:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787383364.623537:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874206984911488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787383364.623809:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1787383364.623856:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503172300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874206984911616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787383364.623904:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383364.623917:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636055a2cc0 going to sleep for 11 seconds 00000100:00080000:1.0:1787383364.623975:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787383364.624095:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984911616 00000100:00100000:3.0:1787383364.624100:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984911616 00000100:00100000:3.0:1787383364.624138:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787383364.624145:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1874206984911616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787383364.624255:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1874206984911616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (350us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787383364.624262:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787383364.624341:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503172300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6523:1874206984911616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787383364.624386:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1787383364.624419:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.624429:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.624436:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.624442:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383364.624446:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.624454:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.624470:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96363d897b00) 00010000:00010000:1.0:1787383364.624473:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787383364.624478:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.624496:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532ef92 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787383364.624804:0:6523:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787383364.624861:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1787383364.624873:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397653106900ns, next at 398653104616ns, rc = 0 00000001:00080000:1.0:1787383364.624880:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1787383364.624903:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96363d897b00) 00010000:00010000:1.0:1787383364.624907:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787383364.624913:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532ef7d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402909 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383364.625080:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+34:12227:x1874206965967744:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 8529us (8716us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1787383364.625089:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 38 00000020:00080000:1.0:1787383364.625093:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787383364.627910:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383364.628182:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965968000 00000100:00100000:2.0:1787383364.628191:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965968000 00000100:00100000:2.0:1787383364.628293:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 162 00000100:00100000:2.0:1787383364.628304:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+34:12227:x1874206965968000:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1787383364.628328:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383364.628350:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532ef99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402910 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.628416:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532ef99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402910 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.628445:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532ef99 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402910 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.628465:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:2.0:1787383364.628468:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383364.628472:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9e00, rc 0) 00000100:00100000:2.0:1787383364.628534:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+35:12227:x1874206965968000:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 232us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383364.628542:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 162 00000100:00100000:3.0:1787383364.631668:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383364.631816:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965968256 00000100:00100000:0.0:1787383364.631825:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965968256 00000100:00100000:0.0:1787383364.631881:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:0.0:1787383364.631891:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+35:12227:x1874206965968256:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383364.632152:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+36:12227:x1874206965968256:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 262us (489us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787383364.632161:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:1.0:1787383364.665735:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383364.665812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383364.665849:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383364.666794:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965968640 00000100:00100000:2.0:1787383364.666807:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965968640 00000100:00100000:2.0:1787383364.666878:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 150 00000100:00100000:2.0:1787383364.666888:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965968640:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383364.666962:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2404:x1874206965968640:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 74us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383364.666969:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 150 00000100:00100000:0.0:1787383364.667138:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965968384 00000100:00100000:0.0:1787383364.667143:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965968384 00000100:00100000:0.0:1787383364.667180:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 386 00000100:00100000:0.0:1787383364.667189:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965968384:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383364.667220:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2404:x1874206965968384:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 34us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383364.667227:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 386 00000100:00100000:1.0:1787383364.667420:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383364.667515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383364.667538:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965968896 00000100:00100000:1.0:1787383364.667542:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965968896 00000100:00100000:0.0:1787383364.667966:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965968512 00000100:00100000:0.0:1787383364.667971:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965968512 00000100:00100000:0.0:1787383364.668001:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965968768 00000100:00100000:0.0:1787383364.668004:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965968768 00000100:00100000:0.0:1787383364.668022:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 311 00000100:00100000:0.0:1787383364.668029:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965968512:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383364.668067:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2404:x1874206965968512:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 38us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383364.668074:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 311 00000100:00100000:0.0:1787383364.668086:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 312 00000100:00100000:0.0:1787383364.668093:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965968768:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383364.668115:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965968768:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383364.668133:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 312 00000100:00080000:3.0:1787383364.668349:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787383364.668360:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383364.668698:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 313 00000100:00100000:1.0:1787383364.668708:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965968896:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383364.668751:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2404:x1874206965968896:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 45us (2901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383364.668795:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 313 00000100:00100000:2.0:1787383364.695836:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383364.695921:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965969152 00000100:00100000:0.0:1787383364.695931:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965969152 00000100:00100000:2.0:1787383364.696349:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 163 00000100:00100000:2.0:1787383364.696545:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+36:12237:x1874206965969152:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1787383364.696936:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383364.696959:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532efa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402917 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383364.697441:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787383364.697543:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532efa0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402917 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.697823:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635032cd200) 00010000:00010000:2.0:1787383364.697828:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383364.697834:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532efa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402917 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.697851:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9200, rc 0) 00000100:00100000:2.0:1787383364.697925:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+37:12237:x1874206965969152:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1566us (2098us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1787383364.697934:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 163 00000100:00100000:3.0:1787383364.704135:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383364.704589:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965969280 00000100:00100000:1.0:1787383364.704601:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965969280 00000100:00100000:1.0:1787383364.704669:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 164 00000100:00100000:1.0:1787383364.704687:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+37:12237:x1874206965969280:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:1.0:1787383364.704803:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532efae lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.704822:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532efae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.704834:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532efae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.704846:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532efb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.704853:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532efb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.704871:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532efb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.704949:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532efbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.704958:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532efbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.704965:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532efbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383364.705028:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532efbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705041:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532efae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705047:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532efae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705053:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532efae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705058:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383364.705061:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532efae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705068:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532efae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705078:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:1.0:1787383364.705080:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383364.705085:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532efae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705091:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532efae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705102:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532efb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705108:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532efb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705120:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532efb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705125:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383364.705128:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532efb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705134:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532efb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705142:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96363d897300) 00010000:00010000:1.0:1787383364.705145:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383364.705147:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532efb5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705153:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532efb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705163:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532efbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705168:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532efbc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705174:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532efbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705179:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383364.705182:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532efbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705198:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532efbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705207:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:1.0:1787383364.705209:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383364.705212:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532efbc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383364.705218:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532efbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383364.705293:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+37:12237:x1874206965969280:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 615us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383364.705301:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 164 00000100:00100000:3.0:1787383364.710360:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383364.710499:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965969536 00000100:00100000:0.0:1787383364.710508:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965969536 00000100:00100000:0.0:1787383364.710562:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:0.0:1787383364.710571:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+37:12237:x1874206965969536:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383364.711605:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+38:12237:x1874206965969536:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 1031us (1249us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787383364.711614:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:2.0:1787383364.779127:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383364.779206:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965969792 00000100:00100000:0.0:1787383364.779216:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965969792 00000100:00100000:0.0:1787383364.779287:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 165 00000100:00100000:0.0:1787383364.779297:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+38:12240:x1874206965969792:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383364.779323:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383364.779347:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532efc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340291e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779446:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532efca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779472:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532efca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779484:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532efca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779495:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532efd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779520:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532efd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779527:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532efd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779684:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532efd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779694:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532efd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779701:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532efd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383364.779712:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787383364.779851:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532efca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779859:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532efca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779865:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532efca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779872:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383364.779877:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532efca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779884:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532efca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779909:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:0.0:1787383364.779913:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383364.779919:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532efca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779927:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532efca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779940:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532efd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779946:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532efd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779952:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532efd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779958:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383364.779961:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532efd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779966:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532efd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779973:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96363d897300) 00010000:00010000:0.0:1787383364.779975:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383364.779978:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532efd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.779985:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532efd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.780037:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532efc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340291e expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.780050:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532efd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340291e expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383364.780058:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:0.0:1787383364.780061:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383364.780063:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17000, rc 0) 00000100:00100000:0.0:1787383364.780133:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+40:12240:x1874206965969792:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 837us (1016us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787383364.780143:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 165 00000100:00100000:3.0:1787383364.786997:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383364.788547:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965969920 00000100:00100000:2.0:1787383364.788561:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965969920 00000100:00100000:2.0:1787383364.788691:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 166 00000100:00100000:2.0:1787383364.788702:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+40:12240:x1874206965969920:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:2.0:1787383364.788798:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532efe6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.788815:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532efe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.788826:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532efe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.788872:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532efe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.788879:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532efe6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.788900:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532efe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.788906:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383364.788910:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532efe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.788917:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532efe6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.788930:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:2.0:1787383364.788933:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383364.788938:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532efe6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383364.788944:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532efe6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383364.789034:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+40:12240:x1874206965969920:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 333us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383364.789042:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 166 00000100:00100000:3.0:1787383364.793475:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383364.793963:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965970176 00000100:00100000:0.0:1787383364.793974:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965970176 00000100:00100000:0.0:1787383364.794038:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:0.0:1787383364.794052:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+40:12240:x1874206965970176:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383364.794526:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+41:12240:x1874206965970176:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 474us (1058us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787383364.794536:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:2.0:1787383365.203755:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383365.204277:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965970432 00000100:00100000:3.0:1787383365.204289:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965970432 00000100:00100000:3.0:1787383365.204362:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 167 00000100:00100000:3.0:1787383365.204374:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+41:12271:x1874206965970432:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:3.0:1787383365.204400:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383365.204423:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532efed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402925 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.204550:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532eff4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.205857:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532eff4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.205875:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532eff4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383365.205893:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787383365.206023:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532efed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402925 expref: 44 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.206042:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532eff4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402925 expref: 43 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.206050:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:3.0:1787383365.206066:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383365.206070:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600031e00, rc 0) 00000100:00100000:3.0:1787383365.206259:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+43:12271:x1874206965970432:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1887us (2514us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787383365.206268:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 167 00000100:00100000:3.0:1787383365.224728:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383365.224814:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383365.224900:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965970688 00000100:00100000:0.0:1787383365.224909:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965970688 00000100:00100000:0.0:1787383365.224962:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:0.0:1787383365.224973:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+43:12271:x1874206965970688:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:0.0:1787383365.225211:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+44:12271:x1874206965970688:12345-192.168.203.2@tcp:35:cat.0 Request processed in 239us (492us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787383365.225232:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:2.0:1787383365.226140:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965970816 00000100:00100000:2.0:1787383365.226150:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965970816 00000100:00100000:2.0:1787383365.226208:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:2.0:1787383365.226218:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+44:2403:x1874206965970816:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383365.226231:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383365.226255:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532eff4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402925 expref: 44 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383365.226291:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:2.0:1787383365.226297:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383365.226343:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+43:2403:x1874206965970816:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 126us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383365.226350:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00010000:00010000:0.0:1787383365.274940:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383365.295575:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383365.295684:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965971072 00000100:00100000:0.0:1787383365.295693:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965971072 00000100:00100000:0.0:1787383365.295754:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 168 00000100:00100000:0.0:1787383365.295795:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+43:12277:x1874206965971072:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:0.0:1787383365.295823:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383365.295827:0:10098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787383365.295856:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532ef5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028fb expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.295873:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:0.0:1787383365.295876:0:10098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383365.295890:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f002 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340292c expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.295976:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.295985:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532efd8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340291e expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.295991:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.296014:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532efd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340291e expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.296037:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532efd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340291e expref: 43 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383365.296047:0:10098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984911744:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383365.296114:0:10098:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610d41c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383365.299380:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383365.299455:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965971200 00000100:00100000:2.0:1787383365.299464:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965971200 00010000:00010000:2.0:1787383365.299496:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532efd8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340291e expref: 44 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383365.299527:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 82 00000100:00100000:2.0:1787383365.299533:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636420d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+44:2402:x1874206965971200:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383365.299544:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383365.299549:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532efd8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340291e expref: 44 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383365.299566:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532efd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340291e expref: 44 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383365.299589:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:2.0:1787383365.299595:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383365.299605:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383365.299612:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383365.299656:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383365.299727:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636420d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+44:2402:x1874206965971200:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 192us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383365.299735:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 82 00010000:00010000:0.0:1787383365.300377:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532efd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340291e expref: 43 pid: 6521 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383365.300395:0:10098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984911744:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383365.300413:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.300423:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.300428:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383365.300446:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787383365.300576:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f002 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340292c expref: 44 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.300590:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340292c expref: 43 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.300598:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:0.0:1787383365.300609:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787383365.306578:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17c00, rc 0) 00000100:00100000:0.0:1787383365.306687:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+43:12277:x1874206965971072:12345-192.168.203.2@tcp:101:dd.0 Request processed in 10909us (11106us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787383365.306936:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 168 00000100:00100000:1.0:1787383365.313153:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383365.315582:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965971328 00000100:00100000:2.0:1787383365.315598:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965971328 00000100:00100000:2.0:1787383365.315664:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 169 00000100:00100000:2.0:1787383365.315690:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+43:12277:x1874206965971328:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:2.0:1787383365.315715:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383365.315734:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532f017 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402933 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383365.315786:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f01e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383365.315800:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f01e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383365.315811:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f01e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383365.315944:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532f017 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402933 expref: 45 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383365.315964:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f01e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402933 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383365.315973:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:2.0:1787383365.315982:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383365.315986:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9400, rc 0) 00000100:00100000:2.0:1787383365.316072:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+44:12277:x1874206965971328:12345-192.168.203.2@tcp:101:dd.0 Request processed in 399us (2927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383365.316080:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 169 00000100:00100000:3.0:1787383365.321942:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383365.329285:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965971584 00000100:00100000:1.0:1787383365.329301:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965971584 00000100:00100000:1.0:1787383365.331752:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 170 00000100:00100000:1.0:1787383365.331792:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+44:12277:x1874206965971584:12345-192.168.203.2@tcp:36:dd.0 00010000:00010000:1.0:1787383365.332045:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f025 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383365.332063:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f025 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383365.332076:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f025 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383365.332146:0:9499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1787383365.332168:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007b156018 reply state 00000000b336f7ac transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f025 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383365.332181:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f025 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383365.332189:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:1.0:1787383365.332192:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787383365.332195:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383365.332293:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+47:12277:x1874206965971584:12345-192.168.203.2@tcp:36:dd.0 Request processed in 527us (10358us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1787383365.332301:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 170 00000020:00080000:1.0:1787383365.332306:0:9499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787383365.660719:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383365.660812:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965971712 00000100:00100000:0.0:1787383365.660823:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965971712 00000100:00100000:0.0:1787383365.660914:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 171 00000100:00100000:0.0:1787383365.660924:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+47:12291:x1874206965971712:12345-192.168.203.2@tcp:101:stat.0 00010000:00010000:0.0:1787383365.660948:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383365.660968:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f02c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340293a expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.661030:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f033 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.661043:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f033 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.661052:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f033 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.661062:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f03a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.661100:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f03a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.661108:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f03a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.661190:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f041 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.661201:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340292c expref: 48 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.661209:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f041 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.661237:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340292c expref: 48 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.661248:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340292c expref: 48 pid: 10098 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383365.661261:0:10098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984911872:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383365.661359:0:10098:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610d41c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383365.667667:0:10098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984911872:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383365.667713:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f041 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383365.670855:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383365.670959:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965971968 00000100:00100000:0.0:1787383365.670969:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965971968 00000100:00100000:0.0:1787383365.671027:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:0.0:1787383365.671038:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+49:6170:x1874206965971968:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787383365.671305:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+50:6170:x1874206965971968:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 268us (456us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787383365.671326:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:3.0:1787383365.673623:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383365.673731:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965972096 00000100:00100000:0.0:1787383365.673740:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965972096 00010000:00010000:0.0:1787383365.673813:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340292c expref: 50 pid: 10098 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383365.673907:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 83 00000100:00100000:0.0:1787383365.673917:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+50:2402:x1874206965972096:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383365.673930:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383365.673938:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340292c expref: 50 pid: 10098 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.673951:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340292c expref: 50 pid: 10098 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.673972:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f009 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340292c expref: 50 pid: 10098 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.673987:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:0.0:1787383365.673991:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f041 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.674001:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.674009:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f041 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.674059:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383365.674118:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+49:2402:x1874206965972096:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 201us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383365.674125:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 83 00010000:00010000:3.0:1787383365.674584:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.674593:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383365.674699:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787383365.674704:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383365.674725:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.674738:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.674747:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f033 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.674754:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f033 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.674759:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f033 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.674870:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383365.674875:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f033 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.674883:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f033 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.674894:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:3.0:1787383365.674897:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383365.674901:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f033 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.674907:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f033 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.674920:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f03a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.674925:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f03a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.675012:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f03a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.675017:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383365.675019:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f03a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.675024:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f03a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.675042:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96363d897300) 00010000:00010000:3.0:1787383365.675044:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383365.675047:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f03a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.675053:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f03a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.675092:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f02c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340293a expref: 49 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.675106:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f041 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340293a expref: 48 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.675114:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:3.0:1787383365.675116:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383365.675119:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16600, rc 0) 00000100:00100000:3.0:1787383365.675178:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+48:12291:x1874206965971712:12345-192.168.203.2@tcp:101:stat.0 Request processed in 14256us (14470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383365.675186:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 171 00000100:00100000:3.0:1787383365.783430:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383365.783502:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965972352 00000100:00100000:0.0:1787383365.783512:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965972352 00000100:00100000:0.0:1787383365.783572:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 172 00000100:00100000:0.0:1787383365.783581:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+48:12298:x1874206965972352:12345-192.168.203.2@tcp:36:truncate.0 00010000:00010000:0.0:1787383365.783645:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383365.783680:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f041 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340293a expref: 48 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.783701:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:0.0:1787383365.783705:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383365.783929:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f048 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.783944:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f048 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.783954:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f048 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787383365.784004:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1787383365.784029:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cfc11f9b reply state 00000000305347d5 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f048 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.784042:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f048 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383365.784063:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:0.0:1787383365.784066:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383365.784068:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383365.784179:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+50:12298:x1874206965972352:12345-192.168.203.2@tcp:36:truncate.0 Request processed in 598us (758us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787383365.784187:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 172 00000020:00080000:0.0:1787383365.784193:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787383365.787903:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984912000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383365.787972:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383365.788476:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984912000 00000100:00100000:0.0:1787383365.788484:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984912000 00000100:00100000:0.0:1787383365.788541:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787383365.788551:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984912000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383365.788583:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787383365.789021:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984912000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 471us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383365.789030:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787383365.789241:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984912000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787383365.994119:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383365.994202:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965972480 00000100:00100000:3.0:1787383365.994211:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965972480 00000100:00100000:3.0:1787383365.994272:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 173 00000100:00100000:3.0:1787383365.994282:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+50:12312:x1874206965972480:12345-192.168.203.2@tcp:101:stat.0 00010000:00010000:3.0:1787383365.994304:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383365.994323:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f04f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402941 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994397:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f056 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994411:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f056 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994423:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f056 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994434:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f05d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994440:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994447:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994511:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f064 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994520:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f064 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994527:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f064 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383365.994565:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787383365.994569:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383365.994587:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f064 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994842:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f064 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994852:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f056 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994858:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f056 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994863:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f056 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994868:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383365.994871:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f056 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994877:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f056 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994887:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:3.0:1787383365.994890:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383365.994893:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f056 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994898:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f056 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994910:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994915:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f05d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994926:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f05d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994930:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383365.994933:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f05d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994938:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f05d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994944:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96363d897300) 00010000:00010000:3.0:1787383365.994946:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383365.994949:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f05d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994954:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f05d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994977:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f04f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402941 expref: 52 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994988:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f064 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402941 expref: 51 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383365.994995:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:3.0:1787383365.994997:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383365.994999:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600031e00, rc 0) 00000100:00100000:3.0:1787383365.995050:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+51:12312:x1874206965972480:12345-192.168.203.2@tcp:101:stat.0 Request processed in 769us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383365.995064:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 173 00000100:00100000:2.0:1787383366.113679:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383366.113759:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965972736 00000100:00100000:3.0:1787383366.113798:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965972736 00000100:00100000:3.0:1787383366.113870:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 174 00000100:00100000:3.0:1787383366.113881:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+51:12322:x1874206965972736:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383366.113902:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383366.113922:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f06b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402948 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383366.114023:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787383366.114120:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f06b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402948 expref: 53 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.114138:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635032cd200) 00010000:00010000:3.0:1787383366.114141:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787383366.114145:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f06b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402948 expref: 53 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.114159:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600031200, rc 0) 00000100:00100000:3.0:1787383366.114220:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+52:12322:x1874206965972736:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 341us (559us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1787383366.114226:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 174 00000100:00080000:1.0:1787383366.116073:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383366.119485:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383366.119563:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965972992 00000100:00100000:3.0:1787383366.119574:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965972992 00000100:00100000:3.0:1787383366.119637:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:3.0:1787383366.119646:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628e5a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+52:12322:x1874206965972992:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1787383366.120048:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628e5a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+53:12322:x1874206965972992:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 401us (569us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1787383366.120056:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:2.0:1787383366.196412:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383366.196573:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965973248 00000100:00100000:1.0:1787383366.196582:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965973248 00000100:00100000:1.0:1787383366.196651:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 175 00000100:00100000:1.0:1787383366.196662:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+53:12328:x1874206965973248:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1787383366.196972:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383366.196994:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f079 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340294f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.197091:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.197124:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f064 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402941 expref: 54 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.197134:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.197168:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f064 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402941 expref: 54 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.197182:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f064 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402941 expref: 54 pid: 9499 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383366.197196:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984912128:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383366.197329:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff96362252d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383366.206883:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984912128:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383366.206913:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383366.211864:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383366.212265:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965973376 00000100:00100000:3.0:1787383366.212342:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965973376 00010000:00010000:3.0:1787383366.212443:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f064 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402941 expref: 55 pid: 9499 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383366.212484:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 84 00000100:00100000:3.0:1787383366.212495:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+55:2402:x1874206965973376:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383366.212510:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383366.212517:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f064 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402941 expref: 55 pid: 9499 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.212530:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f064 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402941 expref: 55 pid: 9499 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.212725:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f064 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402941 expref: 55 pid: 9499 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.212743:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:3.0:1787383366.212748:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.212757:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.213030:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.213079:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383366.213141:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+54:2402:x1874206965973376:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 647us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.213149:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 84 00010000:00010000:1.0:1787383366.213221:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.213230:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383366.213248:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787383366.213515:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f079 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340294f expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.213595:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340294f expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.213613:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:1.0:1787383366.213616:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787383366.213618:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1e00, rc 0) 00000100:00100000:1.0:1787383366.213647:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+54:12328:x1874206965973248:12345-192.168.203.2@tcp:101:bash.0 Request processed in 16988us (17245us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787383366.213654:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 175 00000100:00100000:2.0:1787383366.220008:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383366.220081:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965973632 00000100:00100000:3.0:1787383366.220091:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965973632 00000100:00100000:3.0:1787383366.220158:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 176 00000100:00100000:3.0:1787383366.220168:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+54:12328:x1874206965973632:12345-192.168.203.2@tcp:36:bash.0 00010000:00010000:3.0:1787383366.220460:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f08e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.220478:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f08e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.220489:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f08e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787383366.220530:0:9499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1787383366.222878:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b25abe6f reply state 0000000083f7042b transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f08e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.222901:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f08e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.222909:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:3.0:1787383366.222911:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787383366.222915:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787383366.223247:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+57:12328:x1874206965973632:12345-192.168.203.2@tcp:36:bash.0 Request processed in 3075us (3244us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1787383366.223272:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 176 00000020:00080000:3.0:1787383366.223279:0:9499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787383366.237197:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383366.239186:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965973760 00000100:00100000:0.0:1787383366.239201:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965973760 00000100:00100000:0.0:1787383366.239338:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 177 00000100:00100000:0.0:1787383366.239349:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+57:12328:x1874206965973760:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1787383366.239381:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383366.239402:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f095 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402956 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.239487:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f09c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.239520:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340294f expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.239529:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f09c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.239562:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340294f expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.239575:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340294f expref: 58 pid: 6520 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383366.239588:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984912256:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383366.239893:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503068b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383366.243167:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984912256:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383366.243198:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f09c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383366.244168:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383366.244293:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965973888 00000100:00100000:3.0:1787383366.244302:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965973888 00010000:00010000:3.0:1787383366.244341:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340294f expref: 59 pid: 6520 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383366.244487:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 85 00000100:00100000:3.0:1787383366.244498:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+59:2402:x1874206965973888:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383366.244512:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383366.244520:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340294f expref: 59 pid: 6520 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.244534:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340294f expref: 59 pid: 6520 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.244556:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f080 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340294f expref: 59 pid: 6520 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.244572:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:3.0:1787383366.244578:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f09c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.244588:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f09c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.244595:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f09c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.244641:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383366.244955:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+58:2402:x1874206965973888:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 459us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.244963:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 85 00010000:00010000:0.0:1787383366.245021:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f09c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.245029:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f09c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383366.245077:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787383366.245081:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383366.245098:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f09c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.245139:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f095 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402956 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.245152:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f09c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402956 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.245160:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:0.0:1787383366.245162:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383366.245165:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16e00, rc 0) 00000100:00100000:0.0:1787383366.245191:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+57:12328:x1874206965973760:12345-192.168.203.2@tcp:101:bash.0 Request processed in 5844us (8002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383366.245197:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 177 00000100:00100000:2.0:1787383366.248220:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383366.248308:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965974144 00000100:00100000:1.0:1787383366.248317:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965974144 00000100:00100000:1.0:1787383366.248452:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:1.0:1787383366.248464:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+57:12328:x1874206965974144:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:1.0:1787383366.248692:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+58:12328:x1874206965974144:12345-192.168.203.2@tcp:35:bash.0 Request processed in 229us (479us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787383366.248699:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00010000:00010000:0.0:1787383366.299575:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383366.306400:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383366.306636:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965974400 00000100:00100000:1.0:1787383366.306646:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965974400 00000100:00100000:1.0:1787383366.306720:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 178 00000100:00100000:1.0:1787383366.306730:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+58:12338:x1874206965974400:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383366.306753:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383366.306915:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f0a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340295d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383366.307013:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787383366.307125:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f0a3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340295d expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.307139:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635032cd200) 00010000:00010000:1.0:1787383366.307141:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383366.307145:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f0a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340295d expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.307165:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0c00, rc 0) 00000100:00100000:1.0:1787383366.307222:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+59:12338:x1874206965974400:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 493us (831us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1787383366.307229:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 178 00000100:00100000:2.0:1787383366.310714:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383366.310857:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965974528 00000100:00100000:3.0:1787383366.310866:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965974528 00000100:00100000:3.0:1787383366.310925:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 179 00000100:00100000:3.0:1787383366.310936:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+59:12338:x1874206965974528:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:3.0:1787383366.311014:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f0b1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311028:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311039:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311048:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f0b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311054:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311061:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311121:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f0bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311128:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f0bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311146:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f0bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383366.311187:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f0bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311198:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311204:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f0b1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311211:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f0b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311216:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383366.311221:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f0b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311227:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f0b1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311239:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:3.0:1787383366.311252:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383366.311257:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f0b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311263:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f0b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311287:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311300:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f0b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311306:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311311:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383366.311314:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311320:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f0b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311328:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96363d897300) 00010000:00010000:3.0:1787383366.311331:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383366.311334:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f0b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311340:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f0b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311350:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f0bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311356:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f0bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311371:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f0bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311376:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383366.311385:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f0bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311391:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f0bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311399:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:3.0:1787383366.311401:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383366.311404:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f0bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.311410:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f0bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383366.311488:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+59:12338:x1874206965974528:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 553us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.311496:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 179 00000100:00100000:2.0:1787383366.316307:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383366.316346:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965974784 00000100:00100000:3.0:1787383366.316355:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965974784 00000100:00100000:3.0:1787383366.316399:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:3.0:1787383366.316406:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+59:12338:x1874206965974784:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1787383366.316589:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+60:12338:x1874206965974784:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 182us (291us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787383366.316594:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:0.0:1787383366.364881:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383366.365336:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965975040 00000100:00100000:1.0:1787383366.365346:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965975040 00000100:00100000:1.0:1787383366.365409:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 180 00000100:00100000:1.0:1787383366.365420:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+60:12341:x1874206965975040:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383366.365443:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383366.365553:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f0c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402964 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.365631:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f0cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.365646:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f0cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.365657:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f0cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.365710:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f0d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.365718:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.365725:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.365994:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f0db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366006:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f0db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366014:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f0db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383366.366023:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787383366.366108:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f0cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366116:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f0cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366130:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f0cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366134:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383366.366137:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f0cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366143:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f0cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366154:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:0.0:1787383366.366157:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383366.366162:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f0cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366168:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f0cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366183:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366189:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f0d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366195:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366200:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383366.366203:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366221:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f0d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366230:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96363d897300) 00010000:00010000:0.0:1787383366.366233:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383366.366236:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f0d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366242:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f0d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366284:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f0c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402964 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366297:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f0db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402964 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.366304:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:0.0:1787383366.366306:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383366.366308:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16800, rc 0) 00000100:00100000:0.0:1787383366.366377:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+62:12341:x1874206965975040:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 959us (1506us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787383366.366385:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 180 00000100:00100000:2.0:1787383366.370186:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383366.370245:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383366.370328:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965975168 00000100:00100000:1.0:1787383366.370338:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965975168 00000100:00100000:1.0:1787383366.370408:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 181 00000100:00100000:1.0:1787383366.370418:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+62:12341:x1874206965975168:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:1.0:1787383366.370487:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f0e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.370515:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.370528:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.370562:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.370568:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f0e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.370574:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.370593:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383366.370598:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.370605:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f0e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.370629:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:1.0:1787383366.370632:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383366.370636:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f0e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.370641:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f0e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383366.370734:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+62:12341:x1874206965975168:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 317us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383366.370742:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 181 00000100:00100000:0.0:1787383366.371395:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965975296 00000100:00100000:0.0:1787383366.371403:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965975296 00000100:00100000:0.0:1787383366.371453:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:0.0:1787383366.371461:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+62:2404:x1874206965975296:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383366.371483:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383366.371501:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f0db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402964 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.371969:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:0.0:1787383366.371974:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383366.372021:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+61:2404:x1874206965975296:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 560us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383366.372029:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:1.0:1787383366.376339:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383366.376481:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965975552 00000100:00100000:3.0:1787383366.376490:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965975552 00000100:00100000:3.0:1787383366.376612:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:3.0:1787383366.376621:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+61:12341:x1874206965975552:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1787383366.376942:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+62:12341:x1874206965975552:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 321us (610us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787383366.376963:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:2.0:1787383366.556018:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383366.556131:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965975808 00000100:00100000:0.0:1787383366.556141:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965975808 00000100:00100000:0.0:1787383366.556215:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 182 00000100:00100000:0.0:1787383366.556226:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+62:12359:x1874206965975808:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1787383366.556248:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383366.556268:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f0f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340296b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.556381:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f0f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.556408:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f0f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.556421:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f0f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383366.556432:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787383366.556534:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f0f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340296b expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.556568:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f0f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340296b expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.556577:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:0.0:1787383366.556579:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787383366.556583:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17800, rc 0) 00000100:00100000:0.0:1787383366.556644:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+64:12359:x1874206965975808:12345-192.168.203.2@tcp:101:cat.0 Request processed in 419us (636us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1787383366.556652:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 182 00000100:00100000:2.0:1787383366.604864:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383366.604989:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965975936 00000100:00100000:0.0:1787383366.604999:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965975936 00000100:00100000:0.0:1787383366.605057:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 183 00000100:00100000:0.0:1787383366.605066:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+64:12360:x1874206965975936:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383366.605087:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383366.605117:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402972 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.605187:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f10c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.605202:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f10c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.605213:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f10c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383366.605250:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787383366.605265:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383366.605282:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f10c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.605305:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402972 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.605332:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f10c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402972 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.605340:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:0.0:1787383366.605343:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383366.605346:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17600, rc 0) 00000100:00100000:0.0:1787383366.605402:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12360:x1874206965975936:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 338us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383366.605409:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 183 00000100:00100000:1.0:1787383366.623151:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383366.623456:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965976320 00000100:00100000:0.0:1787383366.623466:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965976320 00000100:00100000:0.0:1787383366.623525:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:0.0:1787383366.623534:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12360:x1874206965976320:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383366.624049:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12360:x1874206965976320:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 514us (907us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787383366.624060:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:2.0:1787383366.627527:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383366.627710:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965976448 00000100:00100000:3.0:1787383366.627720:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965976448 00000100:00100000:3.0:1787383366.627810:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:3.0:1787383366.627821:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12360:x1874206965976448:12345-192.168.203.2@tcp:103:lfs.0 00010000:00010000:3.0:1787383366.627848:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787383366.627873:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f09c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402956 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.627896:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f0f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340296b expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.627908:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532ef99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402910 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.627919:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:3.0:1787383366.627923:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383366.627985:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+63:12360:x1874206965976448:12345-192.168.203.2@tcp:103:lfs.0 Request processed in 166us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.627993:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383366.631278:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383366.631437:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965976576 00000100:00100000:3.0:1787383366.631447:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965976576 00000100:00100000:3.0:1787383366.631541:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 184 00000100:00100000:3.0:1787383366.631552:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+63:12360:x1874206965976576:12345-192.168.203.2@tcp:58:lfs.0 00010000:00010000:3.0:1787383366.631682:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f113 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.635738:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f113 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.635757:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f113 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787383366.636540:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787383366.636721:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+63:12360:x1874206965976576:12345-192.168.203.2@tcp:58:lfs.0 Request processed in 5167us (5618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.636733:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 184 00000100:00100000:0.0:1787383366.659818:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383366.660004:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965976704 00000100:00100000:3.0:1787383366.660015:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965976704 00000100:00100000:3.0:1787383366.660074:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 185 00000100:00100000:3.0:1787383366.660083:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+63:12362:x1874206965976704:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383366.660117:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383366.660136:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f11a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402979 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660211:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f121 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660227:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f121 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660238:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f121 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660249:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f128 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660271:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f128 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660277:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f128 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660356:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f12f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660365:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f12f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660372:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f12f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383366.660411:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787383366.660415:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383366.660433:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f12f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660445:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f12f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660453:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f121 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660459:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f121 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660466:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f121 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660483:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383366.660486:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f121 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660494:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f121 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660506:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:3.0:1787383366.660510:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383366.660514:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f121 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660520:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f121 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660534:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f128 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660539:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f128 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660545:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f128 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660549:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383366.660552:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f128 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660557:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f128 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660575:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96363d897300) 00010000:00010000:3.0:1787383366.660578:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383366.660580:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f128 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660585:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f128 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660611:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f11a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402979 expref: 65 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660624:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f12f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402979 expref: 64 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.660631:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:3.0:1787383366.660633:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383366.660635:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030400, rc 0) 00000100:00100000:3.0:1787383366.660708:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+64:12362:x1874206965976704:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 625us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.660716:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 185 00000040:00080000:3.0:1787383366.811804:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383366.811812:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383366.811950:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787383366.811960:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787383366.812092:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f36a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1874206984912384:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787383366.812367:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635044a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984912512:0@lo:400:kworker.0 00000100:00100000:2.0:1787383366.812413:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383366.812486:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984913024:0@lo:400:kworker.0 00000100:00100000:2.0:1787383366.812514:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383366.812535:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984913536:0@lo:400:kworker.0 00000100:00100000:2.0:1787383366.812558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383366.812576:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984914048:0@lo:400:kworker.0 00000100:00100000:2.0:1787383366.812597:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383366.812619:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787383366.812625:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984912896:0@lo:400:kworker.0 00000100:00100000:2.0:1787383366.812647:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383366.812675:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984913408:0@lo:400:kworker.0 00000100:00100000:2.0:1787383366.812698:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383366.812714:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984913920:0@lo:400:kworker.0 00000100:00100000:2.0:1787383366.812738:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383366.812790:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635044a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984912640:0@lo:400:kworker.0 00000100:00100000:2.0:1787383366.812815:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383366.813716:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503655000 going to sleep for 11 seconds 00000100:00100000:3.0:1787383366.813892:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984913536 00000100:00100000:3.0:1787383366.813911:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984913536 00000100:00100000:3.0:1787383366.813960:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984914048 00000100:00100000:3.0:1787383366.813964:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984914048 00000100:00100000:3.0:1787383366.813977:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984913408 00000100:00100000:3.0:1787383366.813980:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984913408 00000100:00100000:3.0:1787383366.813993:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984913920 00000100:00100000:3.0:1787383366.813996:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984913920 00000100:00100000:3.0:1787383366.814011:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787383366.814020:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984913536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.814090:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984913536:12345-0@lo:400:kworker.0 Request processed in 70us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.814098:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787383366.814115:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787383366.814121:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984914048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.814151:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984914048:12345-0@lo:400:kworker.0 Request processed in 30us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.814156:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787383366.814168:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787383366.814174:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984913408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.814202:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984913408:12345-0@lo:400:kworker.0 Request processed in 28us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.814207:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787383366.814218:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787383366.814224:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984913920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.814252:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984913920:12345-0@lo:400:kworker.0 Request processed in 27us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.814257:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1787383366.814280:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383366.814283:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383366.814312:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984913408:0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.814324:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984913920:0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.814334:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984913536:0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.814344:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984914048:0@lo:400:kworker.0 00000100:00100000:2.0:1787383366.814456:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984913152:0@lo:400:kworker.0 00000100:00100000:2.0:1787383366.814500:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383366.814749:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984912512 00000100:00100000:0.0:1787383366.814755:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984912512 00000100:00100000:0.0:1787383366.814811:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1787383366.819670:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984912512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383366.819849:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984912512:12345-0@lo:400:kworker.0 Request processed in 5024us (7428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383366.819859:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1787383366.819939:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635044a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984912512:0@lo:400:kworker.0 00000100:00100000:2.0:1787383366.822780:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984913664:0@lo:400:kworker.0 00000100:00100000:2.0:1787383366.822860:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383366.828892:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984912896 00000100:00100000:3.0:1787383366.828904:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984912896 00000100:00100000:3.0:1787383366.828951:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984912640 00000100:00100000:3.0:1787383366.828953:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984912640 00000100:00100000:3.0:1787383366.828979:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984913152 00000100:00100000:3.0:1787383366.828982:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984913152 00000100:00100000:3.0:1787383366.829005:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787383366.829022:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984912896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.829118:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984912896:12345-0@lo:400:kworker.0 Request processed in 104us (16469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.829125:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787383366.829141:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787383366.829147:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984912640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.829173:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984912640:12345-0@lo:400:kworker.0 Request processed in 26us (16357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.829188:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1787383366.829199:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787383366.829205:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984913152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.829249:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984913152:12345-0@lo:400:kworker.0 Request processed in 44us (14748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.829260:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787383366.829848:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984913024 00000100:00100000:3.0:1787383366.829854:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984913024 00000100:00100000:3.0:1787383366.829887:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787383366.829893:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984913024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.829931:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984913024:12345-0@lo:400:kworker.0 Request processed in 38us (17417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.829936:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787383366.829961:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984912768:0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.830087:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383366.830163:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984913280:0@lo:400:kworker.0 00000100:00080000:3.0:1787383366.830249:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383366.830261:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984912768 00000100:00100000:3.0:1787383366.830265:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984912768 00000100:00100000:3.0:1787383366.830530:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787383366.830543:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984912768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.830688:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984912768:12345-0@lo:400:kworker.0 Request processed in 147us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.830694:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787383366.830792:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f36a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1874206984912384:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787383366.841212:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984912896:0@lo:400:kworker.0 00000100:00100000:1.0:1787383366.841229:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984913024:0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.842011:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984913664 00000100:00100000:3.0:1787383366.842030:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984913664 00000100:00100000:3.0:1787383366.842088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1787383366.842117:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984913664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383366.849898:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383366.849990:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383366.850049:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984913792:0@lo:400:kworker.0 00000100:00100000:1.0:1787383366.850108:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383366.850161:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984912768:0@lo:400:kworker.0 00000100:00080000:1.0:1787383366.850231:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383366.850248:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965976832 00000100:00100000:1.0:1787383366.850255:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965976832 00000100:00100000:1.0:1787383366.850296:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984913280 00000100:00100000:1.0:1787383366.850300:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984913280 00000100:00080000:1.0:1787383366.850314:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383366.850333:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984913792 00000100:00100000:1.0:1787383366.850336:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984913792 00000100:00080000:1.0:1787383366.850347:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383366.850378:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1787383366.850387:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984913280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383366.850443:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984913280:12345-0@lo:400:kworker.0 Request processed in 58us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383366.850451:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00080000:1.0:1787383366.850485:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f21180 x1874206984913280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383366.850496:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984913280:0@lo:400:kworker.0 00000100:00100000:1.0:1787383366.850513:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787383366.850520:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984913792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383366.850555:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984913792:12345-0@lo:400:kworker.0 Request processed in 36us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383366.850561:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00080000:1.0:1787383366.850584:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f21880 x1874206984913792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383366.850593:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984913792:0@lo:400:kworker.0 00000100:00100000:1.0:1787383366.850623:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 186 00000100:00100000:1.0:1787383366.850639:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+64:12373:x1874206965976832:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787383366.850660:0:6521:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787383366.850788:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+64:12373:x1874206965976832:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 127us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383366.850796:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 186 00000100:00100000:3.0:1787383366.852912:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984913664:12345-0@lo:400:kworker.0 Request processed in 10807us (30043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383366.852926:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635044a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984912640:0@lo:400:kworker.0 00000100:00100000:3.0:1787383366.852944:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787383366.852949:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984913152:0@lo:400:kworker.0 00000100:00100000:2.0:1787383366.852962:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984913664:0@lo:400:kworker.0 00000100:00100000:0.0:1787383366.861586:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383366.861728:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965976960 00000100:00100000:1.0:1787383366.861738:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965976960 00000100:00100000:1.0:1787383366.862016:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 187 00000100:00100000:1.0:1787383366.862028:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+64:12373:x1874206965976960:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787383366.862095:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f136 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862111:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f136 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862122:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f136 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862135:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f13d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862142:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f13d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862148:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f13d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862172:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f144 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862194:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862201:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383366.862244:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787383366.862248:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787383366.862260:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862272:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f136 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862279:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f136 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862286:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f136 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862292:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383366.862296:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f136 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862303:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f136 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862312:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628fc9400) 00010000:00010000:1.0:1787383366.862315:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383366.862319:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f136 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862333:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f136 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862345:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f13d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862350:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f13d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862355:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f13d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862360:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383366.862363:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f13d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862368:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f13d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862374:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff96350366b100) 00010000:00010000:1.0:1787383366.862377:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383366.862379:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f13d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862384:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f13d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862396:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862401:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f144 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862411:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862415:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383366.862419:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862424:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f144 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862431:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:1.0:1787383366.862434:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383366.862436:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f144 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.862442:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f144 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383366.862508:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+64:12373:x1874206965976960:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 Request processed in 482us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383366.862516:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 187 00000100:00100000:3.0:1787383366.865151:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383366.865349:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965977216 00000100:00100000:0.0:1787383366.865359:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965977216 00000100:00100000:0.0:1787383366.865419:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 188 00000100:00100000:0.0:1787383366.865429:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+64:12373:x1874206965977216:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383366.865448:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383366.865469:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f14b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402980 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.865575:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f152 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.865589:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.865601:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383366.865624:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787383366.865710:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.865718:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f152 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.865741:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f152 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.865747:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383366.865751:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f152 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.865758:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f152 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.865792:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:0.0:1787383366.865795:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383366.865859:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f152 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.865867:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f152 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.865907:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f14b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402980 expref: 66 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.865917:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628fc9400) 00010000:00010000:0.0:1787383366.865920:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383366.865923:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f14b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402980 expref: 66 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.865932:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16c00, rc 0) 00000100:00100000:0.0:1787383366.865986:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12373:x1874206965977216:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 558us (842us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1787383366.866003:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 188 00000100:00100000:3.0:1787383366.872748:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383366.872905:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965977344 00000100:00100000:2.0:1787383366.872931:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965977344 00000100:00100000:2.0:1787383366.872983:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 189 00000100:00100000:2.0:1787383366.872992:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12373:x1874206965977344:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787383366.873026:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787383366.873125:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12373:x1874206965977344:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 134us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383366.873133:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 189 00000100:00100000:3.0:1787383366.885147:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383366.885233:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965977600 00000100:00100000:1.0:1787383366.885243:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965977600 00000100:00100000:1.0:1787383366.885302:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 190 00000100:00100000:1.0:1787383366.885311:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12373:x1874206965977600:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383366.885330:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383366.885333:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787383366.885369:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f10c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402972 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.885402:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:1.0:1787383366.885407:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383366.885421:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f160 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402987 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787383366.885833:0:9499:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787383366.885962:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f167 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.885975:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.885984:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.886034:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f160 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402987 expref: 67 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.886048:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f167 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402987 expref: 66 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.886055:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96350366b100) 00010000:00010000:1.0:1787383366.886057:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383366.886060:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0800, rc 0) 00000100:00100000:1.0:1787383366.886109:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12373:x1874206965977600:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 800us (971us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1787383366.886117:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 190 00000100:00100000:1.0:1787383366.911043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383366.915261:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965977856 00000100:00100000:3.0:1787383366.915275:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965977856 00000100:00100000:2.0:1787383366.916833:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 191 00000100:00100000:2.0:1787383366.916846:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12373:x1874206965977856:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383366.916900:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383366.916928:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f167 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402987 expref: 66 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.916944:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96350366b100) 00010000:00010000:2.0:1787383366.916954:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383366.916975:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f175 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.916988:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f175 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.916998:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f175 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917055:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f17c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xe4bf1d0e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917063:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f17c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe4bf1d0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917082:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f17c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe4bf1d0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917130:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f175 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917138:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f175 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917145:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f175 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917152:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383366.917157:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f175 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917165:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f175 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917174:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:2.0:1787383366.917177:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383366.917182:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f175 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917188:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f175 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917197:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f17c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe4bf1d0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917204:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f17c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe4bf1d0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917217:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f17c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe4bf1d0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917222:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383366.917225:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f17c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe4bf1d0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917232:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f17c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe4bf1d0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917241:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xe4bf1d0e (ffff9635032cdc00) 00010000:00010000:2.0:1787383366.917243:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383366.917247:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f17c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe4bf1d0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383366.917253:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f17c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe4bf1d0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383366.917344:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12373:x1874206965977856:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 499us (6310us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383366.917351:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 191 00000100:00100000:1.0:1787383366.926293:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383366.926373:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965977984 00000100:00100000:3.0:1787383366.926383:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965977984 00000100:00100000:3.0:1787383366.926438:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 192 00000100:00100000:3.0:1787383366.926447:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12373:x1874206965977984:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383366.926594:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383366.926626:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f183 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340298e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.926671:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f18a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.926684:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f18a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.926696:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f18a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.926816:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f183 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340298e expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.926834:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f18a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340298e expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383366.926853:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96363d897900) 00010000:00010000:3.0:1787383366.926857:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787383366.926860:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030000, rc 0) 00000100:00100000:3.0:1787383366.927106:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12373:x1874206965977984:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 659us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383366.927114:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 192 00000100:00100000:3.0:1787383366.934685:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383366.934797:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965978240 00000100:00100000:0.0:1787383366.934808:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965978240 00000100:00100000:0.0:1787383366.934862:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 193 00000100:00100000:0.0:1787383366.934872:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12373:x1874206965978240:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787383366.934957:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f191 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.934972:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f191 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.934982:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f191 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383366.935143:0:10098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1787383366.935153:0:10098:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399963386634ns, next at 400963384527ns, rc = 0 00000004:00010000:0.0:1787383366.935200:0:10098:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000670e8bf3 reply state 0000000012b57671 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f191 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.935212:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f191 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.935221:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96363d897900) 00010000:00010000:0.0:1787383366.935223:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787383366.935227:0:10098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383366.935314:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+68:12373:x1874206965978240:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 442us (637us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787383366.935321:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 193 00000100:00100000:1.0:1787383366.941999:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383366.942128:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965978368 00000100:00100000:0.0:1787383366.942151:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965978368 00000100:00100000:0.0:1787383366.942212:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 194 00000100:00100000:0.0:1787383366.942222:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+68:12373:x1874206965978368:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383366.942248:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383366.942271:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f198 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402995 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.942328:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f198 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402995 expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.942343:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f198 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402995 expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.942373:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96363d897900) 00010000:00010000:0.0:1787383366.942377:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787383366.942381:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16000, rc 0) 00000100:00100000:0.0:1787383366.942443:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+69:12373:x1874206965978368:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 222us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383366.942451:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 194 00000100:00100000:3.0:1787383366.946294:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383366.946377:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965978496 00000100:00100000:0.0:1787383366.946387:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965978496 00000100:00100000:0.0:1787383366.946460:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:0.0:1787383366.946470:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+6:2403:x1874206965978496:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787383366.946750:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2403:x1874206965978496:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 280us (464us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787383366.946757:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00080000:1.0:1787383366.946971:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383366.957714:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383366.957808:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965978752 00000100:00100000:0.0:1787383366.957827:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965978752 00000100:00100000:0.0:1787383366.957882:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:0.0:1787383366.957892:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+69:12373:x1874206965978752:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787383366.958120:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+70:12373:x1874206965978752:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 228us (415us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1787383366.958129:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:0.0:1787383366.972302:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383366.973399:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965979008 00000100:00100000:2.0:1787383366.973410:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965979008 00000100:00100000:2.0:1787383366.973479:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 195 00000100:00100000:2.0:1787383366.973490:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+70:12373:x1874206965979008:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787383366.973614:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+70:12373:x1874206965979008:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 125us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383366.973622:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 195 00000100:00100000:2.0:1787383366.976369:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383366.976755:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965979136 00000100:00100000:1.0:1787383366.976787:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965979136 00000100:00100000:1.0:1787383366.976843:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 196 00000100:00100000:1.0:1787383366.976853:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+70:12373:x1874206965979136:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383366.976873:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383366.976893:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f19f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f340299c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.976958:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f1a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.976973:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.976985:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383366.977028:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787383366.977047:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.977071:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f19f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340299c expref: 72 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.977087:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340299c expref: 71 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383366.977110:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96363d897900) 00010000:00010000:1.0:1787383366.977113:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787383366.977117:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0800, rc 0) 00000100:00100000:1.0:1787383366.977177:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+71:12373:x1874206965979136:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 325us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383366.977184:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 196 00000100:00100000:3.0:1787383366.982655:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383366.984199:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965979264 00000100:00100000:0.0:1787383366.984210:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965979264 00000100:00100000:0.0:1787383366.984267:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:0.0:1787383366.984277:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206965979264:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383366.984294:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383366.984315:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532f1ad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029a3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383366.984340:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a894e47, blocks: 0x0 00010000:00010000:0.0:1787383366.984371:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1787383366.984376:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383366.984384:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532f1ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029a3 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.984402:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532f1ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029a3 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383366.984415:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16800, rc 0) 00000100:00100000:0.0:1787383366.984481:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2401:x1874206965979264:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 205us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383366.984496:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:0.0:1787383367.002039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383367.002104:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965979520 00000100:00100000:2.0:1787383367.002113:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965979520 00000100:00100000:2.0:1787383367.002170:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 197 00000100:00100000:2.0:1787383367.002179:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+71:12373:x1874206965979520:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787383367.002286:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+71:12373:x1874206965979520:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 108us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383367.002293:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 197 00000100:00100000:3.0:1787383367.011672:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383367.011753:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965979648 00000100:00100000:0.0:1787383367.011786:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965979648 00000100:00100000:0.0:1787383367.011839:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:0.0:1787383367.011849:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+8:12373:x1874206965979648:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383367.011867:0:8914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383367.011885:0:8914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec91532f1b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029aa expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.011918:0:8914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532f1ad lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029a3 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.011926:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383367.011931:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383367.011936:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec91532f1b4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029aa expref: 9 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.011997:0:8914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532f1ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029a3 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.012010:0:8914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532f1ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029a3 expref: 9 pid: 8436 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383367.012024:0:8914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8914:1874206984914176:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383367.012115:0:8914:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503068d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383367.015364:0:8914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8914:1874206984914176:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383367.015398:0:8914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec91532f1b4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029aa expref: 9 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.015419:0:8914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16a00, rc 0) 00000100:00100000:0.0:1787383367.015468:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+9:12373:x1874206965979648:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 3621us (3815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383367.015477:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:0.0:1787383367.034546:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383367.034629:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965979776 00000100:00100000:3.0:1787383367.034639:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965979776 00010000:00010000:3.0:1787383367.034688:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532f1ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029a3 expref: 9 pid: 8436 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383367.034744:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 86 00000100:00100000:3.0:1787383367.034754:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965979776:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383367.034793:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383367.034816:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532f1ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029a3 expref: 9 pid: 8436 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.034831:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532f1ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029a3 expref: 9 pid: 8436 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.034874:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532f1ad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029a3 expref: 9 pid: 8436 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.034892:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383367.034896:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383367.034904:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec91532f1b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029aa expref: 8 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.034914:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec91532f1b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029aa expref: 8 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.034954:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec91532f1b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029aa expref: 8 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383367.034969:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1874206984914304:192.168.203.2@tcp:105: 00000100:00100000:3.0:1787383367.035045:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503655000 going to sleep for 11 seconds 00000100:00100000:3.0:1787383367.047175:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383367.047614:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1874206984914304:192.168.203.2@tcp:105: 00010000:00010000:2.0:1787383367.047638:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383367.047722:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2402:x1874206965979776:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 12967us (13184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383367.047734:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 86 00000100:00100000:1.0:1787383367.052136:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965979904 00000100:00100000:1.0:1787383367.052155:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965979904 00002000:00100000:1.0:1787383367.052212:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff963503cbfb80 x1874206965979904/t0(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:153/0 lens 504/0 e 0 to 0 dl 1787383378 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787383367.052223:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503cbfb80 with x1874206965979904 ext(0->8) 00002000:00010000:1.0:1787383367.052229:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963503cbfb80 00000100:00100000:1.0:1787383367.052267:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:1.0:1787383367.052276:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2401:x1874206965979904:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787383367.055695:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+10:2401:x1874206965979904:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 Request processed in 3401us (8510us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787383367.055715:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00002000:00100000:1.0:1787383367.055733:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff963503cbfb80 x1874206965979904/t4294967316(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:153/0 lens 504/448 e 0 to 0 dl 1787383378 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787383367.055744:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503cbfb80 with x1874206965979904 ext(0->8) 00002000:00010000:1.0:1787383367.055752:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963503cbfb80 00000100:00100000:2.0:1787383367.063850:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383367.063992:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965980032 00000100:00100000:1.0:1787383367.064001:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965980032 00000100:00100000:1.0:1787383367.064070:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 198 00000100:00100000:1.0:1787383367.064078:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+71:12373:x1874206965980032:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787383367.068945:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1787383367.068959:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1787383367.069018:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787383367.069042:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96363db91b40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787383367.069047:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963503dedb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff963601377480 00000020:00080000:3.0:1787383367.069050:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963503ded000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9636102b5600 00010000:00010000:0.0:1787383367.069148:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532eedc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069159:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532eedc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069167:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532eedc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069173:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383367.069178:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532eedc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069185:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532eedc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069202:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff96363d897500) 00010000:00010000:0.0:1787383367.069205:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383367.069223:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532eedc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069229:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030200/0xc40acec91532eedc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069250:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532eee3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069257:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532eee3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069263:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532eee3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069268:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383367.069271:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532eee3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069277:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532eee3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069286:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:0.0:1787383367.069288:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383367.069291:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532eee3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069297:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030800/0xc40acec91532eee3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069311:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ef22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069317:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ef22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069331:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ef22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069336:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383367.069340:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ef22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069346:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ef22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069367:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96363d897300) 00010000:00010000:0.0:1787383367.069370:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383367.069374:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ef22 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069380:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030600/0xc40acec91532ef22 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069395:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f025 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069400:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f025 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069406:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f025 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069411:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383367.069414:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f025 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069431:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f025 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069440:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:0.0:1787383367.069442:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383367.069446:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f025 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069451:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f025 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069463:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f048 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069470:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f048 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069476:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f048 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069481:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383367.069484:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f048 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069490:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f048 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069498:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:0.0:1787383367.069501:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383367.069503:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f048 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069520:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f048 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069532:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f08e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069538:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f08e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069543:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f08e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069548:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383367.069551:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f08e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069557:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f08e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069565:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:0.0:1787383367.069567:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383367.069570:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f08e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069575:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031200/0xc40acec91532f08e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069586:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f191 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069592:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f191 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069617:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f191 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069622:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383367.069625:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f191 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069632:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f191 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069640:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96363d897900) 00010000:00010000:0.0:1787383367.069642:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787383367.069645:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f191 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.069650:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f191 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787383367.070011:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787383367.070066:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787383367.070183:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+19:12373:x1874206965980032:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 Request processed in 6101us (6336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383367.070193:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 198 00000100:00100000:0.0:1787383367.070385:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984914432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787383367.070434:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383367.071070:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984914432 00000100:00100000:1.0:1787383367.071079:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984914432 00000100:00100000:1.0:1787383367.071128:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787383367.071136:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984914432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787383367.071249:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787383367.071253:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787383367 00002000:00010000:1.0:1787383367.071255:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787383367.071257:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787383367 -> 1787383367 00002000:00010000:1.0:1787383367.071260:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787383367.071305:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1874206984914432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (870us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787383367.071312:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:0.0:1787383367.071402:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9635045b9f80/2, rc 0, transno 4294967317 00000100:00100000:0.0:1787383367.071408:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984914432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787383367.071645:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984914560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787383367.071697:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383367.072003:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984914560 00000100:00100000:2.0:1787383367.072009:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984914560 00000100:00100000:2.0:1787383367.072047:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787383367.072055:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1874206984914560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787383367.072071:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1787383367.072098:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a894e44, atime: 0x6a894e44, ctime: 0x6a894e44, blocks: 0x8 00010000:00010000:2.0:1787383367.072105:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006300b606/0xc40acec91532f1bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.072121:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1787383367.072126:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383367.072132:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006300b606/0xc40acec91532f1bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.072155:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006300b606/0xc40acec91532f1bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.072165:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006300b606/0xc40acec91532f1bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.072173:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006300b606/0xc40acec91532f1bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.072188:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787383367.072466:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3650:x1874206984914560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 410us (766us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787383367.072473:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:3.0:1787383367.072547:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff963503f22a00/2, rc 0, transno 4294967308 00000100:00100000:3.0:1787383367.072553:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984914560:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787383367.072686:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383367.072692:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006300b606/0xc40acec91532f1bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.072701:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9a00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383367.072836:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006300b606/0xc40acec91532f1bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.072861:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006300b606/0xc40acec91532f1bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.072878:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006300b606/0xc40acec91532f1bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.072886:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006300b606/0xc40acec91532f1bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.072904:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383367.072906:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383367.072907:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383367.079319:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383367.079411:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965980160 00000100:00100000:1.0:1787383367.079421:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965980160 00000100:00100000:1.0:1787383367.079477:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:1.0:1787383367.079486:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+10:2402:x1874206965980160:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787383367.081697:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:0.0:1787383367.081724:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000100:00100000:1.0:1787383367.097439:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965980160:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 Request processed in 17942us (18119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383367.097452:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:1.0:1787383367.106159:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383367.106254:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965980416 00000100:00100000:2.0:1787383367.106264:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965980416 00000100:00100000:2.0:1787383367.106323:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 199 00000100:00100000:2.0:1787383367.106334:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+19:12373:x1874206965980416:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383367.106385:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383367.106414:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f1a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340299c expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.106433:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96363d897900) 00010000:00010000:2.0:1787383367.106438:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383367.106470:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532f1c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.106501:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532f1c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.106510:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532f1c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383367.106636:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d3585d82 reply state 000000006ed535d3 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532f1c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.106648:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532f1c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.106654:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96363d897900) 00010000:00010000:2.0:1787383367.106657:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787383367.106670:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383367.106814:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+20:12373:x1874206965980416:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 481us (662us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1787383367.106822:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 199 00000100:00100000:0.0:1787383367.117759:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383367.121592:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965980544 00000100:00100000:1.0:1787383367.121605:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965980544 00000100:00100000:1.0:1787383367.121680:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:1.0:1787383367.121690:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206965980544:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787383367.121882:0:8914:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787383367.121893:0:8914:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787383367 -> 1787383366 00002000:00010000:1.0:1787383367.121895:0:8914:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787383364 00002000:00010000:1.0:1787383367.121898:0:8914:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787383367 -> 1787383366 00002000:00010000:1.0:1787383367.121900:0:8914:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787383367.121963:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2401:x1874206965980544:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 274us (4214us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787383367.121973:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:3.0:1787383367.134748:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383367.134977:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965980800 00000100:00100000:0.0:1787383367.134986:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965980800 00000100:00100000:0.0:1787383367.135060:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 200 00000100:00100000:0.0:1787383367.135070:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+20:12373:x1874206965980800:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787383367.135136:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.135151:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f18a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340298e expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.135160:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.135194:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f18a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340298e expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.135207:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f18a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340298e expref: 20 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383367.135222:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504693100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984914688:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383367.135320:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503068840 going to sleep for 11 seconds 00000100:00100000:0.0:1787383367.141594:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504693100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984914688:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383367.141633:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383367.143077:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383367.143159:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965980928 00000100:00100000:0.0:1787383367.143168:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965980928 00010000:00010000:0.0:1787383367.143202:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f18a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340298e expref: 21 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383367.143237:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 87 00000100:00100000:0.0:1787383367.143260:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636420d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+21:2401:x1874206965980928:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383367.143274:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383367.143281:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f18a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340298e expref: 21 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.143292:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f18a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340298e expref: 21 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.143312:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030000/0xc40acec91532f18a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f340298e expref: 21 pid: 6521 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.143328:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96363d897900) 00010000:00010000:0.0:1787383367.143332:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.143341:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.143350:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.143381:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383367.143446:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636420d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+20:2401:x1874206965980928:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 187us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383367.143453:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 87 00010000:00010000:2.0:1787383367.143928:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.143936:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.143974:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.143980:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.143986:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.143999:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383367.144004:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.144012:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.144023:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96363d897900) 00010000:00010000:2.0:1787383367.144026:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787383367.144030:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.144037:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f1c9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383367.144092:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+19:12373:x1874206965980800:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 Request processed in 9023us (9353us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787383367.144099:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 200 00000100:00100000:0.0:1787383367.152655:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383367.152746:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965981056 00000100:00100000:2.0:1787383367.152757:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965981056 00000100:00100000:2.0:1787383367.152842:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:2.0:1787383367.152853:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362db08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2402:x1874206965981056:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787383367.152901:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.152924:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec91532f1b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029aa expref: 8 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.152947:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383367.152951:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383367.152956:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.152996:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec91532f1b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029aa expref: 8 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.153010:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec91532f1b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029aa expref: 8 pid: 8914 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383367.153025:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874206984914816:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383367.153100:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636055a29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383367.155350:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874206984914816:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383367.155377:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383367.159692:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383367.165487:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965981184 00000100:00100000:0.0:1787383367.165504:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965981184 00010000:00010000:0.0:1787383367.165554:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec91532f1b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029aa expref: 9 pid: 8914 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383367.165651:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 88 00000100:00100000:0.0:1787383367.165675:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2401:x1874206965981184:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383367.165690:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383367.165724:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec91532f1b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029aa expref: 9 pid: 8914 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.165739:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec91532f1b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029aa expref: 9 pid: 8914 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.165784:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec91532f1b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029aa expref: 9 pid: 8914 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.165809:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383367.165814:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383367.165820:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.165830:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.165860:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383367.165913:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2401:x1874206965981184:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 253us (6229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383367.165920:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 88 00010000:00010000:3.0:1787383367.165991:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.166002:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.166023:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.166031:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.166039:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.166047:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383367.166051:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.166060:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.166084:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.166092:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f1d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383367.166141:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362db08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965981056:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 Request processed in 13290us (13494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383367.166149:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:1.0:1787383367.170656:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383367.171063:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965981440 00000100:00100000:3.0:1787383367.171074:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965981440 00000100:00100000:3.0:1787383367.171167:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 201 00000100:00100000:3.0:1787383367.171177:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+19:12373:x1874206965981440:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787383367.171258:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.171274:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f01e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402933 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.171284:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.171318:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f01e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402933 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.171331:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f01e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402933 expref: 19 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383367.171433:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984914944:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383367.171519:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503655b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383367.184386:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383367.184589:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984914944:192.168.203.2@tcp:104: 00010000:00010000:3.0:1787383367.184694:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383367.186478:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965981568 00000100:00100000:2.0:1787383367.186491:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965981568 00010000:00010000:2.0:1787383367.186531:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f01e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402933 expref: 20 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383367.186702:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 89 00000100:00100000:2.0:1787383367.186720:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+20:2402:x1874206965981568:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383367.186745:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383367.186752:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f01e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402933 expref: 20 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.186781:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f01e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402933 expref: 20 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.186814:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f01e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402933 expref: 20 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.186827:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:2.0:1787383367.186832:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.186841:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.186848:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.186874:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383367.186930:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+19:2402:x1874206965981568:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 212us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383367.186938:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 89 00010000:00010000:1.0:1787383367.187246:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.187255:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.187415:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.187428:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f198 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402995 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.187437:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.187472:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f198 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402995 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.187485:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f198 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402995 expref: 19 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383367.187513:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963605594700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984915072:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383367.187573:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361aee8300 going to sleep for 11 seconds 00000100:00100000:0.0:1787383367.206952:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383367.206980:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963605594700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984915072:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383367.207009:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383367.207036:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965981696 00000100:00100000:3.0:1787383367.207043:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965981696 00010000:00010000:3.0:1787383367.207077:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f198 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402995 expref: 20 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383367.207114:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 90 00000100:00100000:3.0:1787383367.207124:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+20:2402:x1874206965981696:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383367.207138:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383367.207145:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f198 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402995 expref: 20 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.207157:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f198 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402995 expref: 20 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.207178:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f198 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402995 expref: 20 pid: 6522 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.207193:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96363d897900) 00010000:00010000:3.0:1787383367.207198:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.207219:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.207226:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.207257:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383367.207291:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.207299:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383367.207304:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+19:2402:x1874206965981696:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 182us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383367.207312:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 90 00000001:00080000:1.0:1787383367.207412:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1787383367.207530:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1787383367.207567:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1787383367.207637:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963605594700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1874206984915200:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787383367.207688:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383367.207717:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4780 going to sleep for 11 seconds 00000100:00100000:3.0:1787383367.207808:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984915200 00000100:00100000:3.0:1787383367.207814:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984915200 00000100:00100000:3.0:1787383367.207847:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787383367.207855:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1874206984915200:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787383367.207930:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1874206984915200:12345-0@lo:1000:mdt00_000.0 Request processed in 75us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383367.207937:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787383367.210351:0:6520:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1787383367.210361:0:6520:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9635045b9f80, transno 4294967317 00000100:00100000:1.0:1787383367.210386:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963605594700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1874206984915200:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787383367.210533:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1787383367.210601:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1874206984915328:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787383367.210655:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383367.210697:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383367.210993:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984915328 00000100:00100000:2.0:1787383367.211000:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984915328 00000100:00100000:2.0:1787383367.211050:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787383367.211058:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1874206984915328:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787383367.211187:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6520:x1874206984915328:12345-0@lo:1000:mdt00_000.0 Request processed in 129us (531us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787383367.211199:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787383367.211240:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6520:1874206984915328:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787383367.211279:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211290:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211297:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211303:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383367.211307:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211316:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211331:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96363d897900) 00010000:00010000:2.0:1787383367.211334:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383367.211339:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211346:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1de lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211367:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f113 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211373:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f113 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211387:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f113 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211393:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383367.211396:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f113 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211403:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f113 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211412:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:2.0:1787383367.211415:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383367.211418:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f113 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211424:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031000/0xc40acec91532f113 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211446:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211460:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f12f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402979 expref: 22 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211469:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211492:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f12f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402979 expref: 22 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.211516:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f12f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402979 expref: 22 pid: 10098 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383367.211529:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984915456:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383367.212263:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636055a29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383367.234173:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383367.234175:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1874206984915456:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383367.234208:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383367.234504:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965981824 00000100:00100000:3.0:1787383367.234511:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965981824 00010000:00010000:3.0:1787383367.234547:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f12f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402979 expref: 23 pid: 10098 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383367.234586:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 91 00000100:00100000:3.0:1787383367.234605:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+23:2404:x1874206965981824:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383367.234619:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383367.234627:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f12f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402979 expref: 23 pid: 10098 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.234653:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f12f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402979 expref: 23 pid: 10098 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.234686:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f12f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402979 expref: 23 pid: 10098 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.234702:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:3.0:1787383367.234707:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.234716:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.234723:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383367.234750:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383367.234823:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+22:2404:x1874206965981824:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 228us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383367.234832:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 91 00010000:00010000:1.0:1787383367.234907:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.234915:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.234927:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.234934:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.234941:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.234946:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383367.234950:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.234957:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.234967:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:1.0:1787383367.234970:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383367.234974:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.234979:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f1e5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.235002:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.235008:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.235014:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.235019:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383367.235022:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.235029:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.235037:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cdd00) 00010000:00010000:1.0:1787383367.235040:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787383367.235042:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.235048:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030c00/0xc40acec91532f1d7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383367.235190:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+21:12373:x1874206965981440:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 64013us (64601us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787383367.235198:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 201 00000020:00080000:1.0:1787383367.235202:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787383367.235260:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383367.235265:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383367.235731:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787383367.235741:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787383367.241795:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383367.242041:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965982080 00000100:00100000:1.0:1787383367.242051:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965982080 00000100:00100000:1.0:1787383367.242125:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:1.0:1787383367.242136:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628e59c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+21:12373:x1874206965982080:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787383367.242374:0:6523:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787383367.242403:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1787383367.242433:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.242448:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.242459:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.242467:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1ec lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.242474:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1ec lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.242480:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.242501:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787383367.242575:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628e59c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+23:12373:x1874206965982080:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 441us (811us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787383367.242582:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 50 00000020:00080000:1.0:1787383367.242587:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787383367.242755:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383367.242762:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1ec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.242788:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383367.242793:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1ec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.242809:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.242821:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96363d897900) 00010000:00010000:0.0:1787383367.242824:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787383367.242828:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1ec lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.242834:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f1ec lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.242845:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383367.242846:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383367.242848:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383367.328624:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984915584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383367.328730:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383367.331484:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984915584 00000100:00100000:2.0:1787383367.331498:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984915584 00000100:00100000:2.0:1787383367.331550:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787383367.331560:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1874206984915584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383367.331594:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787383367.331697:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1874206984915584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (2966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383367.332038:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787383367.332157:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984915584:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787383367.332967:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383367.339182:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383367.339208:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963605594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984915712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383367.339275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383367.339881:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984915712 00000100:00100000:1.0:1787383367.339889:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984915712 00000100:00100000:1.0:1787383367.339938:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787383367.339947:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984915712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787383367.339975:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787383367.340036:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984915712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383367.340043:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787383367.340115:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963605594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984915712:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1787383367.604863:0:14605:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787383367.604872:0:14605:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787383367.604910:0:14605:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787383367.604918:0:14605:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787383367.840529:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383367.840552:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963605594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984915840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383367.840619:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383367.840712:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984915840 00000100:00100000:1.0:1787383367.840719:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984915840 00000100:00100000:1.0:1787383367.840760:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787383367.840790:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363f993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984915840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383367.840820:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787383367.840863:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363f993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984915840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383367.840871:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787383367.840917:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963605594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984915840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383367.846252:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383367.846426:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965982336 00000100:00100000:1.0:1787383367.846436:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965982336 00000100:00100000:1.0:1787383367.846484:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 202 00000100:00100000:1.0:1787383367.846493:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+23:12383:x1874206965982336:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383367.846516:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383367.846536:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f1f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029b1 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.846637:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f1fa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.846675:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f1fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.846686:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f1fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383367.846699:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787383367.846823:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f1f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029b1 expref: 26 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.846839:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f1fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029b1 expref: 25 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.846848:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:1.0:1787383367.846851:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787383367.846854:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0800, rc 0) 00000100:00100000:1.0:1787383367.846911:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+25:12383:x1874206965982336:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 418us (668us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787383367.846918:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 202 00000100:00100000:1.0:1787383367.850383:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383367.850566:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965982464 00000100:00100000:2.0:1787383367.850575:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965982464 00000100:00100000:2.0:1787383367.850639:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 203 00000100:00100000:2.0:1787383367.850649:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+25:12383:x1874206965982464:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:2.0:1787383367.850727:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f208 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.850744:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f208 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.850754:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f208 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.850797:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f20f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.850805:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f20f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.850813:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f20f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.850897:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532f216 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.850904:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532f216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.850910:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532f216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383367.850954:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532f216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.850978:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f208 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.850984:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f208 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.850991:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f208 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.850997:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383367.851002:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f208 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851010:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f208 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851023:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:2.0:1787383367.851026:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383367.851030:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f208 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851036:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f208 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851047:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f20f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851054:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f20f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851060:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f20f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851071:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383367.851075:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f20f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851081:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f20f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851088:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9635032cdf00) 00010000:00010000:2.0:1787383367.851091:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383367.851093:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f20f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851099:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f20f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851112:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532f216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851118:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532f216 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851123:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532f216 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851128:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383367.851131:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532f216 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851137:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532f216 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851153:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9635032cd500) 00010000:00010000:2.0:1787383367.851155:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383367.851158:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532f216 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383367.851164:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9800/0xc40acec91532f216 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383367.851234:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+25:12383:x1874206965982464:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 585us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383367.851241:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 203 00000100:00100000:2.0:1787383367.925874:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383367.926138:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965982720 00000100:00100000:1.0:1787383367.926148:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965982720 00000100:00100000:1.0:1787383367.926211:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 204 00000100:00100000:1.0:1787383367.926222:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+25:12386:x1874206965982720:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383367.926246:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383367.926269:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f21d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926385:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f224 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926398:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f224 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926409:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f224 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926423:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f22b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926608:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f22b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926615:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f22b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926742:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f232 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926751:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f232 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926758:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f232 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383367.926798:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787383367.926876:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f224 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926884:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f224 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926897:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f224 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926903:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383367.926907:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f224 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926915:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f224 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926926:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:1.0:1787383367.926930:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383367.926935:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f224 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926941:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f224 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926954:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f22b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.926971:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f22b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.927163:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f22b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.927169:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383367.927172:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f22b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.927189:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f22b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.927198:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96350366b400) 00010000:00010000:1.0:1787383367.927201:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383367.927204:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f22b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.927210:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f22b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.927253:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f21d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029b8 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.927338:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f232 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029b8 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383367.927354:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:1.0:1787383367.927357:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383367.927360:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0e00, rc 0) 00000100:00100000:1.0:1787383367.927503:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+27:12386:x1874206965982720:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1282us (1635us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787383367.927511:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 204 00000100:00100000:1.0:1787383367.937900:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383367.938039:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965982848 00000100:00100000:0.0:1787383367.938057:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965982848 00000100:00100000:0.0:1787383367.938116:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 205 00000100:00100000:0.0:1787383367.938126:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+27:12386:x1874206965982848:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:0.0:1787383367.938189:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f240 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.938222:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.938234:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.938288:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.938296:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f240 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.938304:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.938309:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383367.938314:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.938322:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f240 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.938334:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:0.0:1787383367.938337:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383367.938341:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f240 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383367.938348:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f240 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383367.938562:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+27:12386:x1874206965982848:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 437us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383367.938578:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 205 00000100:00100000:3.0:1787383367.941689:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383367.941864:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965983104 00000100:00100000:0.0:1787383367.941874:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965983104 00000100:00100000:0.0:1787383367.941924:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:0.0:1787383367.941933:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+27:12386:x1874206965983104:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383367.942143:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+28:12386:x1874206965983104:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 211us (471us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1787383367.942151:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:3.0:1787383368.047329:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383368.047708:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965983360 00000100:00100000:0.0:1787383368.047718:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965983360 00000100:00100000:0.0:1787383368.047829:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 206 00000100:00100000:0.0:1787383368.047840:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+28:11919:x1874206965983360:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1787383368.047867:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383368.047889:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f247 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029bf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.048009:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.048023:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f232 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029b8 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.048031:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.048064:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f232 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029b8 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.048090:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f232 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029b8 expref: 29 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383368.048106:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984915968:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383368.048203:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503068180 going to sleep for 11 seconds 00000100:00080000:1.0:1787383368.049234:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383368.055018:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383368.055556:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984915968:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383368.055584:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383368.055867:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965983488 00000100:00100000:3.0:1787383368.055874:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965983488 00010000:00010000:3.0:1787383368.055911:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f232 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029b8 expref: 30 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383368.055956:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 92 00000100:00100000:3.0:1787383368.055965:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+30:2403:x1874206965983488:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383368.055979:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383368.055986:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f232 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029b8 expref: 30 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383368.055998:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f232 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029b8 expref: 30 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383368.056021:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f232 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029b8 expref: 30 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383368.056038:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:3.0:1787383368.056043:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383368.056053:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383368.056060:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383368.056090:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383368.056148:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+29:2403:x1874206965983488:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 183us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383368.056171:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 92 00010000:00010000:0.0:1787383368.060018:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.060036:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383368.060060:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787383368.060208:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f247 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029bf expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.060228:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029bf expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.060238:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:0.0:1787383368.060241:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787383368.060244:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17000, rc 0) 00000100:00100000:0.0:1787383368.060335:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+29:11919:x1874206965983360:12345-192.168.203.2@tcp:101:bash.0 Request processed in 12495us (13013us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1787383368.061974:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 206 00000100:00100000:2.0:1787383368.068329:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383368.068428:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965983616 00000100:00100000:1.0:1787383368.068437:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965983616 00000100:00100000:1.0:1787383368.068501:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 207 00000100:00100000:1.0:1787383368.068524:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+29:11919:x1874206965983616:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1787383368.068548:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383368.068568:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f25c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029c6 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.068603:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f263 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.068615:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.068627:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.068754:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1e00/0xc40acec91532f25c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029c6 expref: 31 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.068797:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f263 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029c6 expref: 30 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.068806:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:1.0:1787383368.068809:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787383368.068813:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1400, rc 0) 00000100:00100000:1.0:1787383368.068875:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+30:11919:x1874206965983616:12345-192.168.203.2@tcp:101:bash.0 Request processed in 352us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383368.068882:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 207 00000100:00100000:3.0:1787383368.072205:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383368.072306:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965983872 00000100:00100000:0.0:1787383368.072316:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965983872 00000100:00100000:0.0:1787383368.072383:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 208 00000100:00100000:0.0:1787383368.072393:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+30:11919:x1874206965983872:12345-192.168.203.2@tcp:36:bash.0 00010000:00010000:0.0:1787383368.072640:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f26a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.072665:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f26a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.072676:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f26a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787383368.072732:0:10098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1787383368.072754:0:10098:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b8162f89 reply state 00000000c237305d transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f26a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.072803:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f26a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.072811:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:0.0:1787383368.072814:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383368.072819:0:10098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787383368.072892:0:10098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1787383368.072977:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+34:11919:x1874206965983872:12345-192.168.203.2@tcp:36:bash.0 Request processed in 585us (781us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787383368.072985:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 208 00000020:00080000:0.0:1787383368.072990:0:10098:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787383368.078005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383368.078737:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965984000 00000100:00100000:0.0:1787383368.078749:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965984000 00000100:00100000:2.0:1787383368.084742:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 209 00000100:00100000:2.0:1787383368.084802:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+34:11919:x1874206965984000:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1787383368.084832:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383368.084854:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f271 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029cd expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.084912:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f271 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029cd expref: 35 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.084928:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f271 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029cd expref: 35 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.084947:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:2.0:1787383368.084963:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383368.084967:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9400, rc 0) 00000100:00100000:2.0:1787383368.085050:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+35:11919:x1874206965984000:12345-192.168.203.2@tcp:101:bash.0 Request processed in 285us (7044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383368.085057:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 209 00000100:00100000:2.0:1787383368.092960:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383368.093045:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965984128 00000100:00100000:1.0:1787383368.093056:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965984128 00000100:00100000:1.0:1787383368.093158:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:1.0:1787383368.093179:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:11919:x1874206965984128:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1787383368.093195:0:8914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383368.093215:0:8914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec91532f278 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029d4 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383368.093237:0:8914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a894e46, atime: 0x6a894e44, ctime: 0x6a894e46, blocks: 0x8 00010000:00010000:1.0:1787383368.093257:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=401s v=(0 0) 00010000:00010000:1.0:1787383368.093262:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383368.093279:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec91532f278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029d4 expref: 8 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.093296:0:8914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec91532f278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029d4 expref: 8 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.093309:0:8914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1e00, rc 0) 00000100:00100000:1.0:1787383368.093364:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+8:11919:x1874206965984128:12345-192.168.203.2@tcp:101:bash.0 Request processed in 187us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383368.093371:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00080000:2.0:1787383368.093414:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383368.096012:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383368.096234:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965984256 00000100:00100000:2.0:1787383368.096244:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965984256 00002000:00010000:2.0:1787383368.096294:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1787383368.096299:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503cbd180 with x1874206965984256 ext(0->18446744073709551615) 00002000:00010000:2.0:1787383368.096309:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963503cbd180. 00000100:00100000:2.0:1787383368.096353:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:2.0:1787383368.096364:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2402:x1874206965984256:12345-192.168.203.2@tcp:10:bash.0 00002000:00010000:2.0:1787383368.096629:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787383368.096633:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787383366 -> 1787383368 00002000:00010000:2.0:1787383368.096636:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1787383364 -> 1787383364 00002000:00010000:2.0:1787383368.096639:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787383366 -> 1787383368 00002000:00010000:2.0:1787383368.096641:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787383368.096706:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965984256:12345-192.168.203.2@tcp:10:bash.0 Request processed in 344us (703us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787383368.096713:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00002000:00010000:2.0:1787383368.096717:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1787383368.096720:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503cbd180 with x1874206965984256 ext(0->18446744073709551615) 00002000:00010000:2.0:1787383368.096725:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963503cbd180. 00000100:00100000:3.0:1787383368.224607:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383368.224727:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965984384 00000100:00100000:2.0:1787383368.224752:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965984384 00000100:00100000:2.0:1787383368.224850:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 210 00000100:00100000:2.0:1787383368.224861:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+35:12400:x1874206965984384:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:2.0:1787383368.224936:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f27f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.224954:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f27f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.224967:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f27f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.224983:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f286 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.224989:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.224995:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225070:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f28d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225078:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f28d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225084:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f28d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383368.225133:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f28d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225155:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f27f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225162:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f27f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225168:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f27f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225173:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383368.225177:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f27f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225184:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f27f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225197:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:2.0:1787383368.225200:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383368.225204:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f27f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225210:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f27f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225223:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225229:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f286 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225235:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225246:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383368.225249:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225256:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f286 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225264:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9635032cd500) 00010000:00010000:2.0:1787383368.225266:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383368.225269:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f286 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225275:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f286 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225288:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f28d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225294:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f28d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225300:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f28d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225305:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383368.225308:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f28d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225314:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f28d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225333:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:2.0:1787383368.225335:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383368.225339:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f28d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.225344:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f28d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383368.225423:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+35:12400:x1874206965984384:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 564us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383368.225432:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 210 00000100:00100000:2.0:1787383368.299548:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383368.300028:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965984640 00000100:00100000:0.0:1787383368.300038:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965984640 00000100:00100000:0.0:1787383368.300103:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 211 00000100:00100000:0.0:1787383368.300112:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+35:12403:x1874206965984640:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383368.300135:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383368.300157:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f294 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029db expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300229:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f29b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300243:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f29b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300253:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f29b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300266:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300272:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300278:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300382:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f2a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300392:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300411:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383368.300421:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787383368.300511:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f29b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300519:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f29b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300525:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f29b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300531:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383368.300535:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f29b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300542:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f29b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300554:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:0.0:1787383368.300556:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383368.300561:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f29b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300567:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f29b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300582:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300588:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300601:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300606:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383368.300609:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300615:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.300624:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff963602a66d00) 00010000:00010000:0.0:1787383368.300627:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383368.301592:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.301605:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.301797:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f294 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029db expref: 38 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.301815:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029db expref: 37 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.301824:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:0.0:1787383368.301826:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787383368.301829:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16200, rc 0) 00000100:00100000:0.0:1787383368.301913:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+37:12403:x1874206965984640:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1801us (2372us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787383368.301937:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 211 00000100:00100000:3.0:1787383368.307760:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383368.308031:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965984768 00000100:00100000:1.0:1787383368.308042:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965984768 00000100:00100000:1.0:1787383368.308158:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 212 00000100:00100000:1.0:1787383368.308169:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+37:12403:x1874206965984768:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:1.0:1787383368.308237:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.308254:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029bf expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.308278:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.308315:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029bf expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.308329:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029bf expref: 37 pid: 6522 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383368.308354:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984916096:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383368.308456:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383368.314069:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383368.314595:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965985024 00000100:00100000:0.0:1787383368.314605:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965985024 00000100:00100000:0.0:1787383368.314693:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:0.0:1787383368.314703:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+38:6170:x1874206965985024:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787383368.315053:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984916096:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383368.315057:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+39:6170:x1874206965985024:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 356us (998us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787383368.315065:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00010000:00010000:1.0:1787383368.315078:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383368.319260:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383368.319368:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965985152 00000100:00100000:0.0:1787383368.319379:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965985152 00010000:00010000:0.0:1787383368.319423:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029bf expref: 39 pid: 6522 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383368.319464:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 93 00000100:00100000:0.0:1787383368.319473:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+39:2401:x1874206965985152:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383368.319498:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383368.319505:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029bf expref: 39 pid: 6522 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.319519:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029bf expref: 39 pid: 6522 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.319541:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f24e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029bf expref: 39 pid: 6522 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.319557:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:0.0:1787383368.319575:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.319586:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.319603:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.319641:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383368.319737:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+38:2401:x1874206965985152:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 257us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383368.319746:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 93 00010000:00010000:1.0:1787383368.320142:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.320151:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.320191:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.320199:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.320206:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.320220:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383368.320225:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.320232:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.320242:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:1.0:1787383368.320245:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383368.320249:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.320254:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383368.320310:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+37:12403:x1874206965984768:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 12143us (12728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383368.320319:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 212 00000100:00100000:3.0:1787383368.328290:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383368.328384:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965985408 00000100:00100000:0.0:1787383368.328395:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965985408 00000100:00100000:0.0:1787383368.328461:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:0.0:1787383368.328471:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+37:12403:x1874206965985408:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383368.329253:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+38:12403:x1874206965985408:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 779us (971us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787383368.329263:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 53 00010000:00010000:0.0:1787383368.348789:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383368.348981:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383368.349003:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984916224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383368.349070:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383368.349179:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984916224 00000100:00100000:1.0:1787383368.349187:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984916224 00000100:00100000:1.0:1787383368.349248:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787383368.349257:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984916224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383368.349277:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1787383368.349323:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984916224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383368.349331:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787383368.349385:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984916224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383368.349504:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383368.349517:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984916352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383368.349549:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383368.349575:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984916352 00000100:00100000:3.0:1787383368.349579:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984916352 00000100:00100000:3.0:1787383368.349603:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787383368.349609:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363dd50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984916352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383368.349618:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1787383368.349647:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363dd50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984916352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383368.349663:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787383368.349897:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984916352:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787383368.350283:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383368.476267:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383368.476380:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965985664 00000100:00100000:1.0:1787383368.476406:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965985664 00000100:00100000:1.0:1787383368.476468:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 213 00000100:00100000:1.0:1787383368.476478:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+38:12414:x1874206965985664:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1787383368.476518:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383368.476538:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2be lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.476620:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f2c5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.476634:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f2c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.476646:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f2c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.476677:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f2cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.476685:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f2cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.476691:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f2cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.476850:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f2d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.476859:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.476866:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383368.476883:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787383368.476965:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f2c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.476972:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f2c5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.476978:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f2c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.476984:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383368.476988:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f2c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.476994:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f2c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.477004:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:1.0:1787383368.477007:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383368.477012:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f2c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.477017:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f2c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.477030:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f2cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.477035:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f2cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.477051:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f2cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.477056:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383368.477059:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f2cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.477065:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f2cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.477074:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff96350366bd00) 00010000:00010000:1.0:1787383368.477076:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383368.477079:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f2cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.477085:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f2cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.477126:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f2be lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029e2 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.477139:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029e2 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.477146:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:1.0:1787383368.477148:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383368.477151:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636013fde00, rc 0) 00000100:00100000:1.0:1787383368.477213:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+40:12414:x1874206965985664:12345-192.168.203.2@tcp:101:cat.0 Request processed in 736us (956us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787383368.477229:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 213 00000100:00100000:2.0:1787383368.483720:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383368.483881:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965985920 00000100:00100000:1.0:1787383368.483893:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965985920 00000100:00100000:1.0:1787383368.483947:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:1.0:1787383368.483957:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+40:12414:x1874206965985920:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:1.0:1787383368.484261:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+41:12414:x1874206965985920:12345-192.168.203.2@tcp:35:cat.0 Request processed in 304us (551us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787383368.484270:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:3.0:1787383368.523150:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383368.523659:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965986176 00000100:00100000:0.0:1787383368.523679:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965986176 00000100:00100000:0.0:1787383368.523999:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 214 00000100:00100000:0.0:1787383368.524011:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+41:12415:x1874206965986176:12345-192.168.203.2@tcp:36:rm.0 00010000:00010000:0.0:1787383368.524091:0:10098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787383368.524118:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f271 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029cd expref: 41 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.524143:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f2d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029e2 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.524156:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f2a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029db expref: 39 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.524167:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f263 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029c6 expref: 38 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.524176:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:0.0:1787383368.524182:0:10098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383368.524202:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f2e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.524214:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f2e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.524223:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f2e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.524236:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f2e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.524243:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.524273:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.524960:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.524973:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.524982:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383368.525210:0:10098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1787383368.525222:0:10098:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401553454619ns, next at 402553451436ns, rc = 0 00010000:00010000:0.0:1787383368.525279:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f2f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.525288:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.525295:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.525301:0:10098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f2f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.525307:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f2f6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.525312:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f2f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526431:0:10098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383368.526458:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526466:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2ef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526472:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526479:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383368.526484:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526492:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2ef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526507:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:0.0:1787383368.526510:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787383368.526514:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2ef lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526521:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f2ef lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526543:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f2e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526550:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f2e1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526573:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f2e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526578:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383368.526581:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f2e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526599:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f2e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526617:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:0.0:1787383368.526620:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383368.526623:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f2e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526637:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91532f2e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383368.526658:0:10098:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a06fe1c reply state 0000000032cf1cc3 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526679:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f2e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.526687:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff963602a66d00) 00010000:00010000:0.0:1787383368.526689:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383368.526692:0:10098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383368.527168:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+39:12415:x1874206965986176:12345-192.168.203.2@tcp:36:rm.0 Request processed in 3155us (4022us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787383368.527178:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 214 00010000:00010000:2.0:1787383368.527551:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383368.527558:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f2f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.527565:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383368.527569:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f2f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.527576:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f2f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.527596:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:2.0:1787383368.527598:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787383368.527601:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f2f6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.527632:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91532f2f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.527645:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383368.527647:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383368.527658:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383368.649253:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383368.649935:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965986432 00000100:00100000:1.0:1787383368.649947:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965986432 00000100:00100000:1.0:1787383368.650013:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 215 00000100:00100000:1.0:1787383368.650024:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+39:12421:x1874206965986432:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1787383368.650049:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383368.650071:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fd800/0xc40acec91532f2fd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029e9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.650171:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f304 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.650186:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f304 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.650198:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f304 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.650209:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f30b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.650235:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f30b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.650242:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f30b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787383368.654565:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787383368.655788:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f312 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.655810:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f312 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.655822:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f312 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.655863:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f304 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.655870:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f304 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.655877:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f304 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.655883:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fde00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383368.655887:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f304 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.655894:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f304 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.655922:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:2.0:1787383368.655926:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383368.655930:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f304 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.655936:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fde00/0xc40acec91532f304 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383368.655952:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000013c7c6da reply state 00000000011e6354 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f30b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.655963:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f30b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.655969:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff963602a66d00) 00010000:00010000:2.0:1787383368.655972:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787383368.655975:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787383368.656013:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636013fd800/0xc40acec91532f2fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029e9 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.656028:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f312 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029e9 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.656036:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9635032cd500) 00010000:00010000:2.0:1787383368.656038:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383368.656040:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9000, rc 0) 00000100:00100000:2.0:1787383368.656183:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+42:12421:x1874206965986432:12345-192.168.203.2@tcp:101:bash.0 Request processed in 6161us (6939us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787383368.656192:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 215 00000100:00100000:3.0:1787383368.665676:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383368.665851:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965986560 00000100:00100000:1.0:1787383368.665861:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965986560 00000100:00100000:1.0:1787383368.665930:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:1.0:1787383368.665940:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2404:x1874206965986560:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1787383368.665958:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383368.665978:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532f320 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029f0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383368.666004:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383368.666022:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=401s v=(0 0) 00010000:00010000:1.0:1787383368.666026:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383368.666035:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532f320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f0 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.666052:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532f320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f0 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.666065:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1000, rc 0) 00000100:00100000:1.0:1787383368.666121:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2404:x1874206965986560:12345-192.168.203.2@tcp:101:bash.0 Request processed in 183us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383368.666145:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00080000:0.0:1787383368.666599:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787383368.669999:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383368.670105:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965986688 00000100:00100000:0.0:1787383368.670115:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965986688 00000100:00100000:0.0:1787383368.670173:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:0.0:1787383368.670184:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+8:12421:x1874206965986688:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1787383368.670201:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383368.670219:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029f7 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.670250:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532f320 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f0 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.670258:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383368.670395:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383368.670403:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.670440:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532f320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f0 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.670454:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532f320 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f0 expref: 9 pid: 8436 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383368.670468:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1874206984916480:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383368.670623:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503068d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383368.692169:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383368.693108:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965986816 00000100:00100000:1.0:1787383368.693118:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965986816 00010000:00010000:1.0:1787383368.693169:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532f320 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f0 expref: 10 pid: 8436 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383368.693215:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 94 00000100:00100000:1.0:1787383368.693225:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636224a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+10:2402:x1874206965986816:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383368.693240:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383368.693276:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532f320 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f0 expref: 10 pid: 8436 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.693291:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532f320 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f0 expref: 10 pid: 8436 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.693319:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383368.693324:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383368.693332:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.693350:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.693390:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383368.693422:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1874206984916608:192.168.203.2@tcp:105: 00000100:00100000:1.0:1787383368.693507:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6780 going to sleep for 11 seconds 00000100:00100000:1.0:1787383368.701816:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1874206984916608:192.168.203.2@tcp:105: 00010000:00010000:1.0:1787383368.701842:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383368.701903:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636224a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+10:2402:x1874206965986816:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 8678us (9742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383368.701913:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 94 00010000:00010000:0.0:1787383368.704244:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ce46346/0xc40acec91532f320 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f0 expref: 9 pid: 8436 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383368.704287:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1874206984916480:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383368.704317:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.704406:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17000, rc 0) 00000100:00100000:0.0:1787383368.705114:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+8:12421:x1874206965986688:12345-192.168.203.2@tcp:101:bash.0 Request processed in 34929us (35121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383368.705124:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:3.0:1787383368.708993:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383368.709409:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965987072 00000100:00100000:1.0:1787383368.709419:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965987072 00000100:00100000:1.0:1787383368.709523:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:1.0:1787383368.709534:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+42:12421:x1874206965987072:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:1.0:1787383368.709865:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+43:12421:x1874206965987072:12345-192.168.203.2@tcp:35:bash.0 Request processed in 332us (879us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787383368.709873:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:2.0:1787383368.943227:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383368.943363:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965987200 00000100:00100000:1.0:1787383368.943373:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965987200 00000100:00100000:1.0:1787383368.943466:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 216 00000100:00100000:1.0:1787383368.943476:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+43:12437:x1874206965987200:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383368.943501:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383368.943520:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f32e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f34029fe expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.943587:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f335 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.943635:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.943656:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383368.943706:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787383368.943710:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787383368.943728:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.943752:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f32e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029fe expref: 45 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.943812:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029fe expref: 44 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.943821:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:1.0:1787383368.943823:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383368.943826:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0e00, rc 0) 00000100:00100000:1.0:1787383368.943882:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+44:12437:x1874206965987200:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 407us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383368.943889:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 216 00000100:00100000:2.0:1787383368.962114:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383368.962204:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965987456 00000100:00100000:0.0:1787383368.962213:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965987456 00000100:00100000:0.0:1787383368.962265:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 217 00000100:00100000:0.0:1787383368.962275:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+44:12437:x1874206965987456:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383368.962296:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383368.962321:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f33c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a05 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.962455:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f343 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.962469:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.962479:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f343 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383368.962489:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787383368.962615:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f33c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a05 expref: 47 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.962634:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f343 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a05 expref: 46 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383368.962643:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9635032cd500) 00010000:00010000:0.0:1787383368.962653:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383368.962657:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16200, rc 0) 00000100:00100000:0.0:1787383368.962721:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+46:12437:x1874206965987456:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 448us (616us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787383368.962729:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 217 00000100:00100000:3.0:1787383368.967876:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383368.968033:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965987712 00000100:00100000:2.0:1787383368.968043:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965987712 00000100:00100000:2.0:1787383368.968106:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 218 00000100:00100000:2.0:1787383368.968116:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+46:12437:x1874206965987712:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1787383368.968141:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383368.968163:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f351 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.968262:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f358 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.968276:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.968288:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f358 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383368.968300:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787383368.968402:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8c00/0xc40acec91532f351 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a0c expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.968422:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f358 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a0c expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383368.968432:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9635032cd500) 00010000:00010000:2.0:1787383368.968435:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787383368.968446:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8e00, rc 0) 00000100:00100000:2.0:1787383368.968508:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+48:12437:x1874206965987712:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 393us (641us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1787383368.968516:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 218 00000100:00100000:2.0:1787383368.980117:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383368.980402:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965987840 00000100:00100000:3.0:1787383368.980412:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965987840 00000100:00100000:3.0:1787383368.980481:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:3.0:1787383368.980490:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+48:2401:x1874206965987840:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383368.980507:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383368.980533:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f343 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a05 expref: 48 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383368.980564:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9635032cd500) 00010000:00010000:3.0:1787383368.980569:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383368.980654:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+47:2401:x1874206965987840:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 157us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383368.980662:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:3.0:1787383368.983740:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383368.988746:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965987968 00000100:00100000:1.0:1787383368.988761:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965987968 00000100:00100000:1.0:1787383368.988848:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:1.0:1787383368.988861:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2402:x1874206965987968:12345-192.168.203.2@tcp:1:lfs.0 00010000:00010000:1.0:1787383368.988905:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.988939:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.988948:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787383368.988952:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787383368.988956:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.988989:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.989002:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 8 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383368.989016:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874206984916736:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383368.989114:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787383368.993188:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874206984916736:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383368.993217:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383368.997457:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383368.998253:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965988096 00000100:00100000:1.0:1787383368.998264:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965988096 00002000:00100000:1.0:1787383368.998320:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff963503684a80 x1874206965988096/t0(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:154/0 lens 504/0 e 0 to 0 dl 1787383379 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787383368.998352:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503684a80 with x1874206965988096 ext(0->8) 00010000:00010000:1.0:1787383368.998363:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 9 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383368.998381:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 9 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383368.998389:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff963503684a80 00000100:00100000:1.0:1787383368.998436:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:1.0:1787383368.998445:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965988096:12345-192.168.203.2@tcp:4:lfs.0 00000100:00100000:1.0:1787383369.002349:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+11:2402:x1874206965988096:12345-192.168.203.2@tcp:4:lfs.0 Request processed in 3893us (4890us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787383369.002363:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00002000:00100000:1.0:1787383369.002376:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff963503684a80 x1874206965988096/t4294967309(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:154/0 lens 504/448 e 0 to 0 dl 1787383379 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787383369.002386:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963503684a80 with x1874206965988096 ext(0->8) 00010000:00010000:1.0:1787383369.002397:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 11 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.002417:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 11 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383369.002435:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff963503684a80 00000100:00100000:2.0:1787383369.012160:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383369.012600:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965988224 00000100:00100000:3.0:1787383369.012610:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965988224 00010000:00010000:3.0:1787383369.012969:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 11 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383369.013004:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 95 00000100:00100000:3.0:1787383369.013013:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+11:2402:x1874206965988224:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383369.013027:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787383369.013043:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787383369.013046:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787383368 00002000:00010000:3.0:1787383369.013049:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787383369 00002000:00010000:3.0:1787383369.013051:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787383368 00002000:00010000:3.0:1787383369.013066:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787383369.013074:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 11 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383369.013088:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 11 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383369.013112:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec91532f327 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029f7 expref: 11 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383369.013128:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383369.013132:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383369.013137:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383369.013147:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383369.013181:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383369.013236:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+10:2402:x1874206965988224:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 223us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383369.013244:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 95 00010000:00010000:1.0:1787383369.014334:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.014368:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.014392:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.014400:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.014409:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.014416:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383369.014421:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.014429:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.014444:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.014451:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099ee0862/0xc40acec91532f366 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383369.014532:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965987968:12345-192.168.203.2@tcp:1:lfs.0 Request processed in 25673us (30800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383369.014541:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:2.0:1787383369.018269:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383369.023137:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965988480 00000100:00100000:0.0:1787383369.023154:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965988480 00000100:00100000:0.0:1787383369.023259:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:0.0:1787383369.023270:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628e5a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+47:12437:x1874206965988480:12345-192.168.203.2@tcp:35:lfs.0 00000004:00010000:0.0:1787383369.023338:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f358 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a0c expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787383369.023536:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1787383369.023568:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787383369.024220:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1787383369.024262:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.024277:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f312 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029e9 expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.024286:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.024339:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f312 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029e9 expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.024353:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f312 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029e9 expref: 51 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383369.024369:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874206984916864:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383369.024451:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503068d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383369.037276:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383369.037376:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965988608 00000100:00100000:1.0:1787383369.037386:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965988608 00010000:00010000:1.0:1787383369.037427:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f312 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029e9 expref: 52 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383369.037473:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 96 00000100:00100000:1.0:1787383369.037482:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+52:2402:x1874206965988608:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383369.037497:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383369.037504:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f312 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029e9 expref: 52 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.037517:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f312 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029e9 expref: 52 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.037540:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9635032cd500) 00010000:00010000:1.0:1787383369.037545:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.037555:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.037562:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.037610:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383369.037694:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+52:2402:x1874206965988608:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 212us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383369.037711:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 96 00010000:00010000:0.0:1787383369.044590:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f312 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029e9 expref: 51 pid: 6522 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383369.044636:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1874206984916864:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383369.044675:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.044686:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.044692:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787383369.044892:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1787383369.045006:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1787383369.045084:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874206984916992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787383369.045144:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383369.045185:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503068e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383369.045537:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984916992 00000100:00100000:2.0:1787383369.045544:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984916992 00000100:00100000:2.0:1787383369.045606:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787383369.045616:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1874206984916992:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787383369.045733:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1874206984916992:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 118us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383369.045742:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:0.0:1787383369.046864:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383369.046922:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874206984916992:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787383369.047050:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1787383369.047113:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874206984917120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787383369.047154:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383369.047183:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635030686c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383369.047593:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984917120 00000100:00100000:2.0:1787383369.047601:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984917120 00000100:00100000:2.0:1787383369.047681:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787383369.047690:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1874206984917120:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787383369.047856:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6524:x1874206984917120:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 166us (700us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787383369.047864:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787383369.048099:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1874206984917120:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787383369.048146:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1787383369.048184:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.048196:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.048204:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.048211:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383369.048215:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.048223:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.048240:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9635032cd500) 00010000:00010000:0.0:1787383369.048243:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787383369.048248:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.048254:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f36d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787383369.048385:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787383369.048447:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1787383369.048458:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402076691527ns, next at 403076689214ns, rc = 0 00000001:00080000:0.0:1787383369.048464:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1787383369.048485:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9635032cd500) 00010000:00010000:0.0:1787383369.048488:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787383369.048495:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f358 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a0c expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383369.048592:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628e5a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+54:12437:x1874206965988480:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 25324us (30332us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787383369.048602:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 56 00000020:00080000:0.0:1787383369.048606:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787383369.064885:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383369.064977:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965988736 00000100:00100000:1.0:1787383369.064987:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965988736 00000100:00100000:1.0:1787383369.065048:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 219 00000100:00100000:1.0:1787383369.065059:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+54:12437:x1874206965988736:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383369.065083:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383369.065107:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f374 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a13 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.065163:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f374 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a13 expref: 55 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.065178:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f374 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a13 expref: 55 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.065197:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:1.0:1787383369.065200:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383369.065204:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0c00, rc 0) 00000100:00100000:1.0:1787383369.065259:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+55:12437:x1874206965988736:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 202us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383369.065268:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 219 00000100:00100000:2.0:1787383369.077101:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383369.077247:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965988992 00000100:00100000:1.0:1787383369.077258:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965988992 00000100:00100000:1.0:1787383369.077328:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:1.0:1787383369.077342:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+55:12437:x1874206965988992:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:1.0:1787383369.077557:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+56:12437:x1874206965988992:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 221us (467us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787383369.077565:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:3.0:1787383369.240744:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383369.241066:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965989120 00000100:00100000:0.0:1787383369.241076:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965989120 00000100:00100000:0.0:1787383369.241144:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 220 00000100:00100000:0.0:1787383369.241155:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+56:12447:x1874206965989120:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:0.0:1787383369.241229:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f37b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241246:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f37b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241258:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f37b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241268:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f382 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241294:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241301:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241376:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f389 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241384:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241390:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383369.241433:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241446:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f37b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241453:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f37b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241459:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f37b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241465:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383369.241469:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f37b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241476:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f37b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241495:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:0.0:1787383369.241497:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383369.241502:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f37b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241508:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f37b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241522:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241528:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f382 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241534:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241539:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383369.241542:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241548:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f382 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241555:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff963602a66d00) 00010000:00010000:0.0:1787383369.241558:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383369.241561:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f382 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241566:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f382 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241586:0:10098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241592:0:10098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f389 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241598:0:10098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f389 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241604:0:10098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383369.241606:0:10098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f389 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241613:0:10098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f389 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241621:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383369.241634:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383369.241638:0:10098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f389 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.241654:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f389 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383369.245742:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+56:12447:x1874206965989120:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 4573us (4994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383369.245757:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 220 00000100:00100000:2.0:1787383369.297365:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383369.297476:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965989376 00000100:00100000:0.0:1787383369.297484:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965989376 00000100:00100000:0.0:1787383369.297557:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 221 00000100:00100000:0.0:1787383369.297581:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+56:12450:x1874206965989376:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383369.297601:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383369.297621:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f390 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a1a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.297701:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f397 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.297715:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f397 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.297726:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f397 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.297738:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f39e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.297745:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f39e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.297751:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f39e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.297892:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f3a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.297901:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.297908:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383369.297927:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787383369.298004:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f397 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298012:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f397 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298018:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f397 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298023:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383369.298027:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f397 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298034:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f397 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298044:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:0.0:1787383369.298047:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383369.298052:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f397 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298057:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f397 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298069:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f39e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298073:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f39e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298089:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f39e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298094:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383369.298097:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f39e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298103:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f39e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298111:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff963602a66d00) 00010000:00010000:0.0:1787383369.298114:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383369.298116:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f39e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298122:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f39e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298157:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f390 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a1a expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298170:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a1a expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.298176:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383369.298178:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383369.298181:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16800, rc 0) 00000100:00100000:0.0:1787383369.298238:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+58:12450:x1874206965989376:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 659us (881us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787383369.298253:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 221 00000100:00100000:2.0:1787383369.301918:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383369.302829:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965989504 00000100:00100000:1.0:1787383369.302840:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965989504 00000100:00100000:1.0:1787383369.302898:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 222 00000100:00100000:1.0:1787383369.302906:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+58:12450:x1874206965989504:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:1.0:1787383369.302971:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f3b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.302987:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.303000:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.303033:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.303040:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f3b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.303047:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f3b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.303053:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383369.303057:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f3b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.303080:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f3b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.303093:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:1.0:1787383369.303096:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383369.303101:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f3b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.303107:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f3b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383369.303188:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+58:12450:x1874206965989504:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 282us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383369.303195:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 222 00000100:00100000:3.0:1787383369.305423:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383369.305531:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965989760 00000100:00100000:1.0:1787383369.305539:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965989760 00000100:00100000:1.0:1787383369.305597:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:1.0:1787383369.305606:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96364098dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+58:12450:x1874206965989760:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:1.0:1787383369.305835:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96364098dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+59:12450:x1874206965989760:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 229us (418us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1787383369.305842:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 58 00010000:00010000:0.0:1787383369.371195:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383369.426007:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383369.426195:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965990016 00000100:00100000:0.0:1787383369.426205:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965990016 00000100:00100000:0.0:1787383369.426271:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 223 00000100:00100000:0.0:1787383369.426281:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+59:12460:x1874206965990016:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1787383369.426306:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383369.426309:0:10098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787383369.426337:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f335 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029fe expref: 59 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.426363:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:0.0:1787383369.426369:0:10098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383369.426383:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3ba lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a21 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.426487:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f3c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.426501:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.426511:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383369.426522:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787383369.426640:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a21 expref: 61 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.427057:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a21 expref: 60 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.427066:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383369.427069:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383369.427072:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17e00, rc 0) 00000100:00100000:0.0:1787383369.427137:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+60:12460:x1874206965990016:12345-192.168.203.2@tcp:101:bash.0 Request processed in 857us (1139us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787383369.427145:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 223 00000100:00100000:2.0:1787383369.433458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383369.433558:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965990144 00000100:00100000:3.0:1787383369.433570:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965990144 00000100:00100000:3.0:1787383369.433672:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:3.0:1787383369.433689:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+60:2403:x1874206965990144:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383369.433704:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383369.433729:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17e00/0xc40acec91532f3c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a21 expref: 60 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383369.433747:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:3.0:1787383369.433752:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383369.433849:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+59:2403:x1874206965990144:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 162us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383369.433857:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:3.0:1787383369.436043:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383369.441577:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965990272 00000100:00100000:0.0:1787383369.441600:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965990272 00000100:00100000:0.0:1787383369.441683:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 224 00000100:00100000:0.0:1787383369.441693:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+59:12460:x1874206965990272:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1787383369.441723:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383369.441743:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a28 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.441996:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f3d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.442011:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.442023:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.442134:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a28 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.442159:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a28 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.442168:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383369.442171:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787383369.442175:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16600, rc 0) 00000100:00100000:0.0:1787383369.442440:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+60:12460:x1874206965990272:12345-192.168.203.2@tcp:101:bash.0 Request processed in 547us (6202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383369.442450:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 224 00000100:00100000:2.0:1787383369.457014:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383369.457115:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965990528 00000100:00100000:0.0:1787383369.457126:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965990528 00000100:00100000:0.0:1787383369.457191:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 225 00000100:00100000:0.0:1787383369.457201:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+60:12460:x1874206965990528:12345-192.168.203.2@tcp:36:bash.0 00010000:00010000:0.0:1787383369.457256:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383369.457284:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f3a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a1a expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.457315:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383369.457321:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383369.457490:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.457504:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.457513:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787383369.457574:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1787383369.457620:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dea11602 reply state 000000008c5c8bbf transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.457640:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.457656:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383369.457659:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383369.457670:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383369.457761:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+62:12460:x1874206965990528:12345-192.168.203.2@tcp:36:bash.0 Request processed in 560us (754us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787383369.457821:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 225 00000020:00080000:0.0:1787383369.457826:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787383369.469494:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383369.470002:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965990656 00000100:00100000:0.0:1787383369.470011:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965990656 00000100:00100000:0.0:1787383369.470120:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 226 00000100:00100000:0.0:1787383369.470130:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+62:12460:x1874206965990656:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1787383369.470154:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383369.470173:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f3e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a2f expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.470260:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.470275:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.470285:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383369.470327:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787383369.470331:0:10098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383369.470358:0:10098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.470383:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f3e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a2f expref: 64 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.470399:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a2f expref: 63 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.470407:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383369.470410:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383369.470413:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16c00, rc 0) 00000100:00100000:0.0:1787383369.470476:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+63:12460:x1874206965990656:12345-192.168.203.2@tcp:101:bash.0 Request processed in 347us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383369.470483:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 226 00000100:00100000:3.0:1787383369.477143:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383369.477484:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965990912 00000100:00100000:2.0:1787383369.477495:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965990912 00000100:00100000:2.0:1787383369.477544:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:2.0:1787383369.477562:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+63:12460:x1874206965990912:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:2.0:1787383369.478196:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+64:12460:x1874206965990912:12345-192.168.203.2@tcp:35:bash.0 Request processed in 633us (1058us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1787383369.478204:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:2.0:1787383369.567808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383369.567960:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965991040 00000100:00100000:0.0:1787383369.567969:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965991040 00000100:00100000:0.0:1787383369.568031:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 227 00000100:00100000:0.0:1787383369.568042:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+64:12466:x1874206965991040:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383369.568066:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383369.568097:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f3f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a36 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.568161:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532f3f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.568191:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532f3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.568202:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532f3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383369.568250:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787383369.568254:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383369.568272:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532f3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.568294:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f3f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a36 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.568310:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532f3f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a36 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.568318:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:0.0:1787383369.568321:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383369.568325:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17a00, rc 0) 00000100:00100000:0.0:1787383369.568565:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12466:x1874206965991040:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 524us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383369.568573:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 227 00000100:00100000:1.0:1787383369.579162:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383369.579840:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965991168 00000100:00100000:2.0:1787383369.579850:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965991168 00000100:00100000:2.0:1787383369.579909:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 228 00000100:00100000:2.0:1787383369.579918:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12466:x1874206965991168:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1787383369.579937:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383369.579956:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f400 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a3d expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580014:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f407 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580028:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f407 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580039:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f407 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580048:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f40e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580071:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f40e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580078:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f40e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580150:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f415 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580161:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580167:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383369.580206:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787383369.580210:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383369.580228:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580239:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580246:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f407 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580251:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f407 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580257:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f407 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580272:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383369.580277:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f407 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580283:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f407 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580295:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:2.0:1787383369.580298:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383369.580302:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f407 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580306:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f407 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580319:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f40e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580324:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f40e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580330:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f40e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580334:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383369.580336:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f40e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580342:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f40e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580359:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff963602a66d00) 00010000:00010000:2.0:1787383369.580362:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383369.580365:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f40e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580370:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9400/0xc40acec91532f40e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580393:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f400 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a3d expref: 67 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580406:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f415 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a3d expref: 66 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383369.580413:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:2.0:1787383369.580415:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383369.580417:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9000, rc 0) 00000100:00100000:2.0:1787383369.580533:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12466:x1874206965991168:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 615us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383369.580541:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 228 00000100:00100000:2.0:1787383369.595293:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383369.595384:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965991424 00000100:00100000:0.0:1787383369.595394:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965991424 00000100:00100000:0.0:1787383369.595452:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 229 00000100:00100000:0.0:1787383369.595461:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12466:x1874206965991424:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383369.595479:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383369.595510:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f41c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a44 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.596170:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.596188:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a2f expref: 67 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.596197:0:10098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f415 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a3d expref: 67 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.596204:0:10098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.596237:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f415 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a3d expref: 67 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.596250:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f415 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a3d expref: 67 pid: 9499 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383369.596264:0:10098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504693480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984917248:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383369.600670:0:10098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a2f expref: 67 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.600692:0:10098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a2f expref: 67 pid: 10098 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383369.600709:0:10098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504693b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984917376:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383369.600835:0:10098:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503068240 going to sleep for 11 seconds 00000100:00100000:2.0:1787383369.602301:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:1.0:1787383369.602477:0:10098:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.2@tcp) returned -22 from blocking AST (req@00000000eea63d2e x1874206984917248) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f415 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a3d expref: 67 pid: 9499 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.602496:0:10098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f415 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a3d expref: 67 pid: 9499 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.602537:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f415 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a3d expref: 67 pid: 9499 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383369.602565:0:10098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504693480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984917248:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383369.603228:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965991552 00000100:00100000:0.0:1787383369.603236:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965991552 00000100:00100000:0.0:1787383369.603302:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1787383369.603312:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+67:2401:x1874206965991552:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383369.603326:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383369.603329:0:6505:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c40acec91532f415) 00010000:00010000:0.0:1787383369.603331:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383369.603384:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+67:2401:x1874206965991552:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 72us (1090us total) trans 0 rc 116/116 00000100:00100000:0.0:1787383369.603391:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:1.0:1787383369.604221:0:10098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504693b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10098:1874206984917376:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383369.604247:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:1.0:1787383369.604253:0:10098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.604263:0:10098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.604272:0:10098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383369.604845:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383369.604922:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965991680 00000100:00100000:1.0:1787383369.604928:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965991680 00010000:00010000:1.0:1787383369.604955:0:7461:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a2f expref: 67 pid: 10098 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383369.604987:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 97 00000100:00100000:1.0:1787383369.604995:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+67:2402:x1874206965991680:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383369.605006:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383369.605012:0:7461:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a2f expref: 67 pid: 10098 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.605040:0:7461:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a2f expref: 67 pid: 10098 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.605060:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f3eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a2f expref: 67 pid: 10098 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.605075:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:1.0:1787383369.605080:0:7461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.605087:0:7461:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.605095:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.605123:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383369.605166:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+66:2402:x1874206965991680:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 172us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383369.605174:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 97 00010000:00010000:0.0:1787383369.605233:0:10098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.605242:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383369.605260:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787383369.605379:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f41c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a44 expref: 67 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.605394:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a44 expref: 66 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.605401:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383369.605404:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787383369.605406:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16e00, rc 0) 00000100:00100000:0.0:1787383369.605431:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12466:x1874206965991424:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 9972us (10147us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787383369.605443:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 229 00000100:00100000:3.0:1787383369.617819:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383369.617864:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965991936 00000100:00100000:0.0:1787383369.617874:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965991936 00000100:00100000:0.0:1787383369.617938:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:0.0:1787383369.617948:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636224a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12466:x1874206965991936:12345-192.168.203.2@tcp:103:lfs.0 00010000:00010000:0.0:1787383369.617965:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383369.617988:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f374 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a13 expref: 66 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.618007:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383369.618011:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383369.618076:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636224a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12466:x1874206965991936:12345-192.168.203.2@tcp:103:lfs.0 Request processed in 128us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383369.618084:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:2.0:1787383369.622727:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383369.622890:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965992064 00000100:00100000:0.0:1787383369.622900:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965992064 00000100:00100000:0.0:1787383369.622960:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 230 00000100:00100000:0.0:1787383369.622971:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12466:x1874206965992064:12345-192.168.203.2@tcp:58:lfs.0 00010000:00010000:0.0:1787383369.623093:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f431 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.623109:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f431 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383369.623121:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f431 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383369.623232:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787383369.623317:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12466:x1874206965992064:12345-192.168.203.2@tcp:58:lfs.0 Request processed in 347us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383369.623325:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 230 00000100:00100000:2.0:1787383369.630828:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383369.630954:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965992192 00000100:00100000:1.0:1787383369.630965:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965992192 00000100:00100000:1.0:1787383369.631022:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 231 00000100:00100000:1.0:1787383369.631031:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+65:12466:x1874206965992192:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383369.631051:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383369.631072:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f438 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a4b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.631143:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f431 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.631154:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f438 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a4b expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.631173:0:6520:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f431 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.631185:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f438 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a4b expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.631197:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:1.0:1787383369.631200:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383369.631203:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f438 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a4b expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383369.631210:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0e00, rc 0) 00000100:00100000:1.0:1787383369.631270:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12466:x1874206965992192:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 240us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383369.631277:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 231 00000100:00100000:3.0:1787383369.783108:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383369.783153:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383369.783239:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383369.783280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383369.783312:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965992832 00000100:00100000:3.0:1787383369.783320:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965992832 00000100:00100000:2.0:1787383369.783440:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965992320 00000100:00100000:2.0:1787383369.783445:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965992320 00000100:00100000:2.0:1787383369.783487:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 388 00000100:00100000:2.0:1787383369.783508:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2402:x1874206965992320:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383369.783586:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2402:x1874206965992320:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 78us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383369.783594:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 388 00000100:00100000:2.0:1787383369.783655:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383369.783702:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965992448 00000100:00100000:3.0:1787383369.783707:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965992448 00000100:00100000:3.0:1787383369.783731:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 320 00000100:00100000:3.0:1787383369.783737:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965992832:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383369.783816:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965992832:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 79us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383369.783823:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 320 00000100:00100000:3.0:1787383369.783838:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 321 00000100:00100000:3.0:1787383369.783852:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965992448:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383369.783881:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206965992448:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 30us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383369.783886:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 321 00000100:00080000:3.0:1787383369.783901:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787383369.783905:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383369.789945:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965992576 00000100:00100000:1.0:1787383369.789960:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965992576 00000100:00100000:1.0:1787383369.790028:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965992704 00000100:00100000:1.0:1787383369.790032:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965992704 00000100:00100000:1.0:1787383369.790066:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 155 00000100:00100000:1.0:1787383369.790077:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963622ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965992576:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383369.790178:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963622ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965992576:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 102us (7023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383369.790187:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 155 00000100:00100000:1.0:1787383369.790206:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 156 00000100:00100000:1.0:1787383369.790213:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965992704:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383369.790238:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965992704:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (6583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383369.790245:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 156 00000100:00100000:3.0:1787383369.800054:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383369.800149:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965992960 00000100:00100000:2.0:1787383369.800160:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965992960 00000100:00100000:2.0:1787383369.800230:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 322 00000100:00100000:2.0:1787383369.800239:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628e92c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965992960:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383369.800308:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628e92c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206965992960:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 70us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383369.800315:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 322 00000100:00080000:3.0:1787383369.800826:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:1.0:1787383369.889496:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1787383369.889510:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:3.0:1787383370.330973:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383370.331001:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383370.331033:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787383370.331045:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787383370.331173:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1874206984917504:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787383370.331291:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503e7be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383370.337450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383370.337636:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1874206984917504:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787383370.338359:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965993088 00000100:00100000:2.0:1787383370.338371:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965993088 00000100:00100000:2.0:1787383370.338498:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 232 00000100:00100000:2.0:1787383370.338508:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12467:x1874206965993088:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787383370.338538:0:9499:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787383370.338701:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12467:x1874206965993088:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 194us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383370.338710:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 232 00000100:00080000:3.0:1787383370.339814:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383370.344833:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383370.345247:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965993216 00000100:00100000:0.0:1787383370.345258:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965993216 00000100:00100000:0.0:1787383370.345321:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 233 00000100:00100000:0.0:1787383370.345340:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12467:x1874206965993216:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787383370.345403:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f43f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345420:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f43f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345433:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f43f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345467:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f446 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345475:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f446 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345482:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f446 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345506:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f44d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345529:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345536:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383370.345601:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787383370.345606:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383370.345618:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345629:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f43f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345636:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f43f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345652:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f43f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345666:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383370.345670:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f43f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345678:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f43f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345689:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628fc9400) 00010000:00010000:0.0:1787383370.345692:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383370.345696:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f43f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345713:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f43f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345729:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f446 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345734:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f446 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345740:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f446 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345745:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383370.345748:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f446 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345754:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f446 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345762:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff963602a66400) 00010000:00010000:0.0:1787383370.345813:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383370.345817:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f446 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345823:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f446 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345839:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345845:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f44d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345857:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f44d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345867:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383370.345870:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f44d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345877:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f44d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345886:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383370.345888:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383370.345891:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f44d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.345896:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16c00/0xc40acec91532f44d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.345966:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12467:x1874206965993216:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 Request processed in 636us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383370.345975:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 233 00000100:00100000:1.0:1787383370.348419:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.348503:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965993472 00000100:00100000:2.0:1787383370.348512:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965993472 00000100:00100000:2.0:1787383370.348586:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 234 00000100:00100000:2.0:1787383370.348595:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+66:12467:x1874206965993472:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383370.348614:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383370.348653:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f454 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a52 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.348761:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f45b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.348817:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f45b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.348830:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f45b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383370.348842:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787383370.348918:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f45b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.348925:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f45b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.348931:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f45b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.348936:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383370.348940:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f45b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.348947:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f45b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.348959:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:2.0:1787383370.348962:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787383370.348966:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f45b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.348983:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f45b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.349028:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f454 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a52 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.349039:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628fc9400) 00010000:00010000:2.0:1787383370.349041:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383370.349045:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f454 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a52 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.349055:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9200, rc 0) 00000100:00100000:2.0:1787383370.349119:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+67:12467:x1874206965993472:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 524us (710us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1787383370.349127:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 234 00000100:00100000:3.0:1787383370.354400:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383370.354588:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965993600 00000100:00100000:0.0:1787383370.354599:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965993600 00000100:00100000:0.0:1787383370.354667:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 235 00000100:00100000:0.0:1787383370.354677:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+67:12467:x1874206965993600:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787383370.354724:0:10098:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787383370.354862:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+67:12467:x1874206965993600:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 187us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383370.354884:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 235 00000100:00100000:1.0:1787383370.361226:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383370.361309:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965993856 00000100:00100000:3.0:1787383370.361319:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965993856 00000100:00100000:3.0:1787383370.361378:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 236 00000100:00100000:3.0:1787383370.361388:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+67:12467:x1874206965993856:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383370.361409:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383370.361412:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787383370.361437:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17a00/0xc40acec91532f3f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a36 expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.361454:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:3.0:1787383370.361470:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383370.361485:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f469 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787383370.362510:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:3.0:1787383370.362680:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f470 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.362694:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.363847:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.363941:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031e00/0xc40acec91532f469 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a59 expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.363974:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f470 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a59 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.363994:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff963628ebf000) 00010000:00010000:3.0:1787383370.364162:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383370.364167:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030400, rc 0) 00000100:00100000:3.0:1787383370.364237:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+68:12467:x1874206965993856:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 2849us (3019us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787383370.364246:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 236 00000100:00100000:3.0:1787383370.374395:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.375151:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965994112 00000100:00100000:2.0:1787383370.375162:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965994112 00000100:00100000:2.0:1787383370.375228:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 237 00000100:00100000:2.0:1787383370.375238:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+68:12467:x1874206965994112:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383370.375294:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383370.375322:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030400/0xc40acec91532f470 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a59 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375341:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff963628ebf000) 00010000:00010000:2.0:1787383370.375352:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383370.375373:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f47e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375399:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f47e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375410:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f47e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375473:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f485 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x5298219e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375480:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f485 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5298219e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375489:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f485 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5298219e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375531:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f47e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375538:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f47e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375544:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f47e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375550:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383370.375555:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f47e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375563:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f47e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375571:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:2.0:1787383370.375580:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383370.375596:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f47e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375603:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f47e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375614:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f485 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5298219e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375620:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f485 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5298219e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375626:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f485 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5298219e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375631:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383370.375634:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f485 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5298219e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375649:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f485 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5298219e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375657:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x5298219e (ffff9635032cdf00) 00010000:00010000:2.0:1787383370.375660:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383370.375663:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f485 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5298219e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.375669:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f485 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5298219e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383370.375752:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+67:12467:x1874206965994112:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 515us (1366us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383370.375930:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 237 00000100:00100000:0.0:1787383370.379264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383370.379666:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965994240 00000100:00100000:1.0:1787383370.379676:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965994240 00000100:00100000:1.0:1787383370.379727:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 238 00000100:00100000:1.0:1787383370.379738:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+67:12467:x1874206965994240:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383370.379759:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383370.379823:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f48c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a60 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.379858:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f493 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.379871:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.379898:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.380303:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1000/0xc40acec91532f48c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a60 expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.380384:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a60 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.380396:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96350366bb00) 00010000:00010000:1.0:1787383370.380412:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787383370.380416:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0c00, rc 0) 00000100:00100000:1.0:1787383370.380488:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+68:12467:x1874206965994240:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 752us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383370.380496:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 238 00000100:00100000:1.0:1787383370.385651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383370.389757:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965994496 00000100:00100000:0.0:1787383370.389791:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965994496 00000100:00100000:0.0:1787383370.389850:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 239 00000100:00100000:0.0:1787383370.389860:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+68:12467:x1874206965994496:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787383370.389944:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f49a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.389974:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f49a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.390004:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f49a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383370.390163:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1787383370.390173:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 403418406682ns, next at 404418404235ns, rc = 0 00000004:00010000:0.0:1787383370.390223:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000292831d8 reply state 00000000ecabf5b2 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f49a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.390236:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f49a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.390244:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96350366bb00) 00010000:00010000:0.0:1787383370.390246:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787383370.390250:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383370.390367:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+70:12467:x1874206965994496:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 508us (4748us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787383370.390375:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 239 00010000:00010000:2.0:1787383370.396162:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383370.396425:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383370.396501:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965994624 00000100:00100000:0.0:1787383370.396511:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965994624 00000100:00100000:0.0:1787383370.396589:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 240 00000100:00100000:0.0:1787383370.396600:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+70:12467:x1874206965994624:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383370.396626:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383370.396654:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f4a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a67 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.396710:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f4a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a67 expref: 71 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.396725:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f4a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a67 expref: 71 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.396745:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96350366bb00) 00010000:00010000:0.0:1787383370.396748:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787383370.396752:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17600, rc 0) 00000100:00100000:0.0:1787383370.397395:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+71:12467:x1874206965994624:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 794us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383370.397404:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 240 00000100:00100000:3.0:1787383370.403521:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383370.403758:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965994752 00000100:00100000:1.0:1787383370.403811:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965994752 00000100:00100000:1.0:1787383370.403886:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:1.0:1787383370.403897:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965994752:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787383370.404310:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383370.404515:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+10:2402:x1874206965994752:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 618us (1002us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787383370.404523:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:1.0:1787383370.417209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.417697:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965995008 00000100:00100000:2.0:1787383370.417707:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965995008 00000100:00100000:2.0:1787383370.417812:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:2.0:1787383370.417822:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+71:12467:x1874206965995008:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787383370.418265:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+72:12467:x1874206965995008:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 442us (1063us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1787383370.418274:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:3.0:1787383370.443532:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.443628:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965995264 00000100:00100000:2.0:1787383370.443647:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965995264 00000100:00100000:2.0:1787383370.443710:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 241 00000100:00100000:2.0:1787383370.443722:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+72:12467:x1874206965995264:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787383370.443869:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+72:12467:x1874206965995264:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 149us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383370.443877:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 241 00000100:00100000:0.0:1787383370.448342:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.449038:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965995392 00000100:00100000:2.0:1787383370.449049:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965995392 00000100:00100000:2.0:1787383370.449115:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 242 00000100:00100000:2.0:1787383370.449126:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+72:12467:x1874206965995392:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383370.449148:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383370.449169:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f4a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a6e expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.449245:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f4af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.449273:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f4af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.449284:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f4af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383370.449330:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383370.449350:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f4af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.449376:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8e00/0xc40acec91532f4a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a6e expref: 74 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.449392:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f4af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a6e expref: 73 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.449400:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96350366bb00) 00010000:00010000:2.0:1787383370.449403:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787383370.449406:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9200, rc 0) 00000100:00100000:2.0:1787383370.449469:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+73:12467:x1874206965995392:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 344us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383370.449477:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 242 00000100:00100000:1.0:1787383370.457414:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.457510:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965995520 00000100:00100000:2.0:1787383370.457520:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965995520 00000100:00100000:2.0:1787383370.457579:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:2.0:1787383370.457589:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+10:2401:x1874206965995520:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383370.457607:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383370.457653:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a75 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383370.457689:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a894e4a, blocks: 0x0 00010000:00010000:2.0:1787383370.457708:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=403s v=(0 0) 00010000:00010000:2.0:1787383370.457713:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383370.457723:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a75 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.457743:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a75 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.457756:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8e00, rc 0) 00000100:00100000:2.0:1787383370.457864:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+11:2401:x1874206965995520:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 276us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383370.457873:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:3.0:1787383370.464167:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383370.464289:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965995776 00000100:00100000:0.0:1787383370.464299:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965995776 00000100:00100000:0.0:1787383370.464359:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 243 00000100:00100000:0.0:1787383370.464369:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+73:12467:x1874206965995776:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787383370.464480:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+73:12467:x1874206965995776:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 112us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383370.464506:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 243 00000100:00100000:3.0:1787383370.471843:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.471896:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965995904 00000100:00100000:2.0:1787383370.471905:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965995904 00000100:00100000:2.0:1787383370.471961:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:2.0:1787383370.471971:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+11:12467:x1874206965995904:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383370.471998:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383370.472020:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec91532f4bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a7c expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.472050:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a75 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.472077:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383370.472081:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383370.472086:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec91532f4bd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a7c expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.472121:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a75 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.472135:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a75 expref: 12 pid: 8436 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383370.472148:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874206984917632:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383370.472357:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361a6d4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383370.480114:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383370.480329:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965996032 00000100:00100000:0.0:1787383370.480347:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965996032 00010000:00010000:0.0:1787383370.480384:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4b6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a75 expref: 13 pid: 8436 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.480425:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 98 00000100:00100000:0.0:1787383370.480433:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+13:2401:x1874206965996032:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383370.480447:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383370.480467:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4b6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a75 expref: 13 pid: 8436 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.480481:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a75 expref: 13 pid: 8436 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.480507:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383370.480512:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383370.480520:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec91532f4bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a7c expref: 13 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.480530:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec91532f4bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a7c expref: 13 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.480566:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec91532f4bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a7c expref: 13 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.480603:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1874206984917760:192.168.203.2@tcp:105: 00000100:00100000:0.0:1787383370.480687:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503068240 going to sleep for 11 seconds 00010000:00010000:2.0:1787383370.481623:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a75 expref: 13 pid: 8436 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383370.481649:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1874206984917632:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383370.481674:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec91532f4bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a7c expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.481685:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9400, rc 0) 00000100:00100000:2.0:1787383370.481733:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+12:12467:x1874206965995904:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 9762us (9898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383370.481754:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:2.0:1787383370.484872:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1874206984917760:192.168.203.2@tcp:105: 00010000:00010000:2.0:1787383370.484897:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383370.484957:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+11:2401:x1874206965996032:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 4523us (4851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383370.484967:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 98 00000100:00100000:3.0:1787383370.490244:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.490575:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965996160 00000100:00100000:2.0:1787383370.490596:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965996160 00002000:00100000:2.0:1787383370.490657:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff96350206bb80 x1874206965996160/t0(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:156/0 lens 504/0 e 0 to 0 dl 1787383381 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383370.490668:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96350206bb80 with x1874206965996160 ext(0->12) 00002000:00010000:2.0:1787383370.490675:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96350206bb80 00000100:00100000:2.0:1787383370.490709:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:2.0:1787383370.490719:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+11:2401:x1874206965996160:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787383370.492017:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+13:2401:x1874206965996160:12345-192.168.203.2@tcp:4:lhsmtool_posix.0 Request processed in 1294us (1778us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787383370.492031:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00002000:00100000:2.0:1787383370.492041:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff96350206bb80 x1874206965996160/t4294967322(0) o4->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:156/0 lens 504/448 e 0 to 0 dl 1787383381 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787383370.492050:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff96350206bb80 with x1874206965996160 ext(0->12) 00002000:00010000:2.0:1787383370.492055:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96350206bb80 00000100:00100000:3.0:1787383370.495696:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383370.495798:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965996288 00000100:00100000:0.0:1787383370.495808:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965996288 00000100:00100000:0.0:1787383370.495869:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 244 00000100:00100000:0.0:1787383370.495879:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+73:12467:x1874206965996288:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787383370.498941:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1787383370.498960:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1787383370.498999:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787383370.499020:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff963503068e40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787383370.499025:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963503065400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff963503068000 00000020:00080000:1.0:1787383370.499029:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963503065d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff963503674600 00000004:00080000:1.0:1787383370.499052:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1787383370.499094:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96362252d000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787383370.499097:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963502536f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96362252da80 00000020:00080000:1.0:1787383370.499099:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963502536a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff963635057400 00000020:00080000:1.0:1787383370.499112:0:6498:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1787383370.499131:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787383370.499197:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787383370.499324:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+27:12467:x1874206965996288:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 Request processed in 3441us (3631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383370.499502:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 244 00000100:00100000:2.0:1787383370.501451:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984918144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787383370.501517:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383370.501569:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383370.501585:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984918016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787383370.501608:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383370.501653:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984918144 00000100:00100000:2.0:1787383370.501660:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984918144 00000100:00100000:2.0:1787383370.501706:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984918016 00000100:00100000:2.0:1787383370.501710:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984918016 00000100:00100000:2.0:1787383370.501730:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787383370.501738:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1874206984918144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787383370.501875:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787383370.501879:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787383370 00002000:00010000:2.0:1787383370.501881:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787383370.501883:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787383370 -> 1787383370 00002000:00010000:2.0:1787383370.501885:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787383370.501922:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1874206984918144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 184us (404us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787383370.501929:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787383370.501946:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787383370.501952:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1874206984918016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787383370.501965:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1787383370.501980:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.502000:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec91532f278 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029d4 expref: 12 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.502009:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787383370.502013:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383370.502024:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.502054:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec91532f278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029d4 expref: 12 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383370.502746:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383370.502762:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984917888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787383370.502822:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383370.502855:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984917888 00000100:00100000:1.0:1787383370.502860:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984917888 00000100:00100000:1.0:1787383370.502887:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787383370.502893:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984917888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787383370.502908:0:8914:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1787383370.502949:0:8914:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a894e48, atime: 0x6a894e49, ctime: 0x6a894e48, blocks: 0x8 00010000:00010000:1.0:1787383370.502956:0:8914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea93f1c2/0xc40acec91532f4cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.502973:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1787383370.502976:0:8914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383370.502981:0:8914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea93f1c2/0xc40acec91532f4cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.502998:0:8914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea93f1c2/0xc40acec91532f4cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.503008:0:8914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea93f1c2/0xc40acec91532f4cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.503016:0:8914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea93f1c2/0xc40acec91532f4cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.503048:0:8914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383370.503216:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383370.503224:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea93f1c2/0xc40acec91532f4cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.503232:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96360516dc00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383370.503237:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea93f1c2/0xc40acec91532f4cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.503245:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea93f1c2/0xc40acec91532f4cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.503261:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea93f1c2/0xc40acec91532f4cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.503269:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea93f1c2/0xc40acec91532f4cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.503289:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383370.503291:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383370.503292:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383370.503460:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984917888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 564us (635us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787383370.503468:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787383370.503519:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383370.503724:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787383370.503730:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000004:00080000:3.0:1787383370.503757:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff963503f22a00, transno 4294967308 00000004:00080000:3.0:1787383370.503803:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:3.0:1787383370.503819:0:3647:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff96350206b800 x1874206984917888/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787383386 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787383370.503831:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96350206b800/2, rc 0, transno 4294967311 00000100:00100000:3.0:1787383370.503836:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984917888:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787383370.503898:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec91532f278 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029d4 expref: 12 pid: 8914 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383370.503918:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1874206984918272:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383370.504173:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361a6d4900 going to sleep for 11 seconds 00000004:00080000:2.0:1787383370.504201:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9635045b4380/2, rc 0, transno 4294967323 00000100:00100000:2.0:1787383370.504206:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984918144:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1787383370.505226:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532f1c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505240:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532f1c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505247:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532f1c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505253:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383370.505258:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532f1c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505265:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532f1c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505280:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff96363d897900) 00010000:00010000:0.0:1787383370.505283:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383370.505288:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532f1c2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505294:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532f1c2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505349:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f26a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505356:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f26a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505361:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f26a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505367:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383370.505370:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f26a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505376:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f26a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505384:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff96350366b000) 00010000:00010000:0.0:1787383370.505387:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383370.505391:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f26a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505397:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f26a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505414:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f2e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505420:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f2e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505427:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f2e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505438:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383370.505441:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f2e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505448:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f2e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505457:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff963602a66d00) 00010000:00010000:0.0:1787383370.505459:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383370.505462:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f2e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505468:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f2e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505481:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f30b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505488:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f30b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505494:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f30b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505500:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383370.505503:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f30b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505510:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f30b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505527:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff963602a66d00) 00010000:00010000:0.0:1787383370.505530:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383370.505533:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f30b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505540:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec91532f30b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505556:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505562:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505568:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505573:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383370.505576:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505702:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505713:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383370.505715:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383370.505718:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505725:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec91532f3dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505755:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f49a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505762:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f49a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505789:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f49a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505795:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383370.505799:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f49a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505805:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f49a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505815:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96350366bb00) 00010000:00010000:0.0:1787383370.505817:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787383370.505820:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f49a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.505826:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f49a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.506295:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.508937:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1874206984918272:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383370.508965:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.510960:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383370.511030:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965996544 00000100:00100000:3.0:1787383370.511040:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965996544 00010000:00010000:3.0:1787383370.511092:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec91532f278 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029d4 expref: 13 pid: 8914 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383370.511139:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 99 00000100:00100000:3.0:1787383370.511150:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+13:2402:x1874206965996544:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383370.511166:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383370.511172:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec91532f278 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029d4 expref: 13 pid: 8914 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.511187:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec91532f278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029d4 expref: 13 pid: 8914 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.511214:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec91532f278 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029d4 expref: 13 pid: 8914 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.511232:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383370.511236:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787383370.511242:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.511267:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.511299:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383370.511338:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965996416 00000100:00100000:1.0:1787383370.511343:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965996416 00000100:00100000:1.0:1787383370.511364:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 77 00000100:00100000:1.0:1787383370.511368:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+13:2402:x1874206965996416:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1787383370.511754:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.511792:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.511802:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.511821:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.511848:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787383370.512820:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+13:2402:x1874206965996544:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 1666us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383370.512832:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 99 00010000:00010000:1.0:1787383370.513358:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383370.513368:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.513392:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383370.513397:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.513408:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.513427:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.513435:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cf7e4ff/0xc40acec91532f4c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.513457:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383370.513459:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383370.513460:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383370.515194:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1874206984918016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13235us (13578us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787383370.515206:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:0.0:1787383370.515600:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9635045b4a80/2, rc 0, transno 4294967324 00000100:00100000:0.0:1787383370.515608:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984918016:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1787383370.516514:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1787383370.516526:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:3.0:1787383370.516681:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965996416:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 Request processed in 5306us (10385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383370.516691:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 77 00000100:00100000:0.0:1787383370.521264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383370.521332:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965996800 00000100:00100000:1.0:1787383370.521344:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965996800 00000100:00100000:1.0:1787383370.521406:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 245 00000100:00100000:1.0:1787383370.521416:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+21:12467:x1874206965996800:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787383370.521471:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383370.521498:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532f4af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a6e expref: 21 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.521534:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96350366bb00) 00010000:00010000:1.0:1787383370.521539:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383370.521569:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96360516d800/0xc40acec91532f4d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.521595:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96360516d800/0xc40acec91532f4d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.521605:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96360516d800/0xc40acec91532f4d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383370.521747:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d65170e reply state 000000006917fc80 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff96360516d800/0xc40acec91532f4d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.521759:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96360516d800/0xc40acec91532f4d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.521807:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96350366bb00) 00010000:00010000:1.0:1787383370.521810:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787383370.521813:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383370.521911:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+22:12467:x1874206965996800:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 496us (657us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1787383370.521918:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 245 00000100:00100000:1.0:1787383370.526440:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.526528:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965996928 00000100:00100000:2.0:1787383370.526539:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965996928 00000100:00100000:2.0:1787383370.526600:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 78 00000100:00100000:2.0:1787383370.526611:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206965996928:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787383370.526760:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787383370.526799:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1787383370 -> 1787383369 00002000:00010000:2.0:1787383370.526801:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787383369 00002000:00010000:2.0:1787383370.526803:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787383370 -> 1787383369 00002000:00010000:2.0:1787383370.526805:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787383370.526857:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2402:x1874206965996928:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 247us (425us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787383370.526865:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 78 00000100:00100000:3.0:1787383370.529552:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.529632:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965997184 00000100:00100000:2.0:1787383370.529652:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965997184 00000100:00100000:2.0:1787383370.529716:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 246 00000100:00100000:2.0:1787383370.529727:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+22:12467:x1874206965997184:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787383370.529888:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.529917:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f493 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a60 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.529927:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.530216:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a60 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.530230:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f493 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a60 expref: 22 pid: 6520 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383370.530243:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984918400:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383370.530350:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361a6d4900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383370.532799:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.533391:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984918400:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383370.533418:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383370.533566:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965997312 00000100:00100000:3.0:1787383370.533573:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965997312 00010000:00010000:3.0:1787383370.533608:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f493 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a60 expref: 23 pid: 6520 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383370.533653:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 100 00000100:00100000:3.0:1787383370.533662:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+23:2401:x1874206965997312:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383370.533676:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383370.533682:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f493 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a60 expref: 23 pid: 6520 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.533694:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a60 expref: 23 pid: 6520 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.533741:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91532f493 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a60 expref: 23 pid: 6520 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.533758:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96350366bb00) 00010000:00010000:3.0:1787383370.533815:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.533826:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.533834:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.533857:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383370.533916:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+22:2401:x1874206965997312:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 254us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383370.533924:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 100 00010000:00010000:0.0:1787383370.534598:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.534607:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.534721:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.534730:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.534737:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.534742:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383370.534746:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.534754:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.534788:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96350366bb00) 00010000:00010000:0.0:1787383370.534791:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787383370.534795:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.534801:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532f4d9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.534872:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+21:12467:x1874206965997184:12345-192.168.203.2@tcp:55:lhsmtool_posix.0 Request processed in 5146us (5325us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787383370.534894:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 246 00000100:00100000:0.0:1787383370.540141:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.543571:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965997440 00000100:00100000:2.0:1787383370.543727:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965997440 00000100:00100000:2.0:1787383370.543929:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 79 00000100:00100000:2.0:1787383370.543941:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2401:x1874206965997440:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787383370.543987:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.544006:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec91532f4bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a7c expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.544029:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383370.544033:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787383370.544038:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.544074:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec91532f4bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a7c expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.544089:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec91532f4bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a7c expref: 8 pid: 8434 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383370.544105:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1874206984918528:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383370.544351:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361a6d4900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383370.547324:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1874206984918528:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383370.547339:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00010000:00010000:2.0:1787383370.547353:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.547447:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965997568 00000100:00100000:0.0:1787383370.547454:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965997568 00010000:00010000:0.0:1787383370.547722:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec91532f4bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a7c expref: 9 pid: 8434 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.547761:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 101 00000100:00100000:0.0:1787383370.548315:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+9:2402:x1874206965997568:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383370.548333:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383370.548361:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec91532f4bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a7c expref: 9 pid: 8434 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.548376:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec91532f4bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a7c expref: 9 pid: 8434 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.548400:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec91532f4bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a7c expref: 9 pid: 8434 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.548415:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383370.548419:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383370.548425:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.548435:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.548559:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383370.548620:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2402:x1874206965997568:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 310us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383370.548628:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 101 00010000:00010000:2.0:1787383370.548697:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.548707:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.548728:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.548743:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.548751:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.548758:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383370.549042:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.549053:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.549065:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.549074:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f07bfe6/0xc40acec91532f4e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383370.549123:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206965997440:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 Request processed in 5184us (8990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383370.549204:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 79 00000100:00100000:0.0:1787383370.551544:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383370.551625:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965997824 00000100:00100000:1.0:1787383370.551645:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965997824 00000100:00100000:1.0:1787383370.551809:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 247 00000100:00100000:1.0:1787383370.551819:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+21:12467:x1874206965997824:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787383370.551934:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.552015:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f3d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a28 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.552022:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.552051:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a28 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.552061:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f3d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a28 expref: 21 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383370.552071:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984918656:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383370.552140:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383370.553798:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383370.553885:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984918656:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383370.553897:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965997952 00000100:00100000:0.0:1787383370.553902:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965997952 00010000:00010000:1.0:1787383370.553906:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.553929:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f3d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a28 expref: 22 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.553968:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 102 00000100:00100000:0.0:1787383370.553977:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+22:2401:x1874206965997952:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383370.553989:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383370.553996:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f3d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a28 expref: 22 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.554009:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a28 expref: 22 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.554031:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f3d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a28 expref: 22 pid: 6521 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.554045:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383370.554051:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f438 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a4b expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.554077:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.554086:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.554098:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.554125:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383370.554169:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.554176:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.554178:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+21:2401:x1874206965997952:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 202us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383370.554185:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 102 00010000:00010000:1.0:1787383370.554337:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.554359:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f4a1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a67 expref: 21 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.554367:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.554390:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f4a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a67 expref: 21 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.554402:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f4a1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a67 expref: 21 pid: 10098 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383370.554421:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984918784:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383370.554462:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6540 going to sleep for 11 seconds 00000100:00100000:3.0:1787383370.558297:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383370.558368:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965998080 00000100:00100000:0.0:1787383370.558378:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965998080 00010000:00010000:0.0:1787383370.558418:0:8450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f4a1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a67 expref: 22 pid: 10098 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.558459:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 103 00000100:00100000:0.0:1787383370.558468:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+22:2401:x1874206965998080:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383370.558482:0:8450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383370.558489:0:8450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f4a1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a67 expref: 22 pid: 10098 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.558501:0:8450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f4a1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a67 expref: 22 pid: 10098 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.558541:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96350366bb00) 00010000:00010000:0.0:1787383370.558546:0:8450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.558554:0:8450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.558561:0:8450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.558650:0:8450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383370.558708:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+22:2401:x1874206965998080:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 239us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383370.558716:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 103 00010000:00010000:1.0:1787383370.561089:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17600/0xc40acec91532f4a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a67 expref: 21 pid: 10098 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383370.561115:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984918784:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383370.561256:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.561267:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.561274:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383370.561404:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1787383370.561560:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1787383370.561612:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1787383370.561713:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874206984918912:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787383370.561826:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383370.561850:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787383370.561993:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984918912 00000100:00100000:2.0:1787383370.562000:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984918912 00000100:00100000:2.0:1787383370.562097:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787383370.562113:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1874206984918912:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787383370.562210:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1874206984918912:12345-0@lo:1000:mdt00_001.0 Request processed in 97us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383370.562216:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787383370.562268:0:6521:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1787383370.562273:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967319 committed transno 4294967323 00000004:00080000:1.0:1787383370.562287:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9635045b4380, transno 4294967323 00000100:00100000:1.0:1787383370.562305:0:6521:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9635045b4a80 x1874206984918016/t4294967324(4294967324) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787383386 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383370.562315:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874206984918912:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787383370.562428:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1787383370.562469:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874206984919040:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787383370.562497:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383370.563474:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051f6240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383370.563505:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984919040 00000100:00100000:3.0:1787383370.563512:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984919040 00000100:00100000:3.0:1787383370.563707:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787383370.563717:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1874206984919040:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787383370.565725:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1874206984919040:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787383370.565800:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.565812:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.565820:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.565827:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96360516c000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383370.565832:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.565858:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.565876:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96350366bb00) 00010000:00010000:1.0:1787383370.565878:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383370.565883:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.565889:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f4ee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.565918:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f431 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.565925:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f431 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.565932:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f431 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.565938:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383370.565942:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f431 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.565948:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f431 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.565959:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:1.0:1787383370.565962:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383370.565969:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f438 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a4b expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.565994:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f438 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a4b expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.566004:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f438 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a4b expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383370.566052:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f438 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a4b expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383370.566068:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984919168:192.168.203.2@tcp:105: 00000100:00100000:1.0:1787383370.570893:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff96362252da80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383370.575990:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6521:x1874206984919040:12345-0@lo:1000:mdt00_001.0 Request processed in 12266us (13483us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787383370.576005:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787383370.577503:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383370.577718:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1874206984919168:192.168.203.2@tcp:105: 00010000:00010000:0.0:1787383370.577749:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f431 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577761:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f431 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577824:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f4f5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577838:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f4f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577849:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f4f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577877:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f4f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577883:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f4f5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577889:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f4f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577896:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383370.577900:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f4f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577907:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f4f5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577919:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383370.577922:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383370.577926:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f4f5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577933:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f4f5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577952:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577959:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577965:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577979:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96360516c400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383370.577982:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577989:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.577998:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383370.578000:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787383370.578003:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.578009:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c400/0xc40acec91532f4e7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.578242:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+24:12467:x1874206965997824:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 26423us (26703us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787383370.578252:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 247 00000020:00080000:0.0:1787383370.578258:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787383370.579933:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965998208 00000100:00100000:2.0:1787383370.580268:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965998208 00000100:00100000:2.0:1787383370.580346:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:2.0:1787383370.580356:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+24:12466:x1874206965998208:12345-192.168.203.2@tcp:49:lfs.0 00000100:00100000:2.0:1787383370.580485:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+24:12466:x1874206965998208:12345-192.168.203.2@tcp:49:lfs.0 Request processed in 131us (2988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383370.580492:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:1.0:1787383370.583274:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000040:00080000:0.0:1787383370.583569:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383370.583583:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383370.584050:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787383370.584058:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787383370.585815:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383370.586293:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965998720 00000100:00100000:0.0:1787383370.586302:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965998720 00000100:00100000:0.0:1787383370.586362:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 248 00000100:00100000:0.0:1787383370.586372:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+24:12466:x1874206965998720:12345-192.168.203.2@tcp:58:lfs.0 00000040:00080000:0.0:1787383370.587098:0:10098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787383370.587367:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+24:12466:x1874206965998720:12345-192.168.203.2@tcp:58:lfs.0 Request processed in 994us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383370.587377:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 248 00000100:00100000:2.0:1787383370.587803:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965998464 00000100:00100000:2.0:1787383370.587810:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965998464 00000100:00100000:2.0:1787383370.587846:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:2.0:1787383370.587853:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628e59050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+24:12467:x1874206965998464:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787383370.588067:0:6523:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787383370.588098:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1787383370.588308:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f4fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.588325:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f4fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.588347:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f4fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.588356:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f4fc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.588376:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f4fc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.588382:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f4fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.588400:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787383370.588462:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628e59050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+26:12467:x1874206965998464:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 609us (5195us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787383370.588470:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00000020:00080000:2.0:1787383370.588474:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787383370.588755:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383370.588781:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f4fc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.588788:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383370.588791:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f4fc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.588799:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f4fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.588812:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96350366bb00) 00010000:00010000:3.0:1787383370.588815:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787383370.588819:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f4fc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.588824:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9000/0xc40acec91532f4fc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383370.588836:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383370.588838:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383370.588839:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383370.665046:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383370.665310:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965998848 00000100:00100000:0.0:1787383370.665319:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965998848 00000100:00100000:0.0:1787383370.665379:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 249 00000100:00100000:0.0:1787383370.665390:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+26:12469:x1874206965998848:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383370.665414:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383370.665434:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f503 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a83 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.665493:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f50a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.665505:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f50a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.665517:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f50a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.665530:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f511 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.665538:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.665544:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.665612:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f518 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.665670:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a44 expref: 27 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.665677:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f518 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.665708:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a44 expref: 27 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.665722:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a44 expref: 27 pid: 10098 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.665735:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504693b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984919296:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383370.666071:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503068000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383370.678363:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383370.678457:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965999104 00000100:00100000:2.0:1787383370.678466:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965999104 00000100:00100000:2.0:1787383370.678533:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:2.0:1787383370.678543:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+28:6170:x1874206965999104:12345-192.168.203.2@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787383370.678997:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+29:6170:x1874206965999104:12345-192.168.203.2@tcp:35:ldlm_bl.0 Request processed in 454us (641us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787383370.679006:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:0.0:1787383370.680481:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504693b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1874206984919296:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383370.680511:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f518 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383370.682116:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383370.687395:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965999232 00000100:00100000:0.0:1787383370.687411:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965999232 00010000:00010000:0.0:1787383370.687460:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a44 expref: 29 pid: 10098 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383370.687496:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 104 00000100:00100000:0.0:1787383370.687506:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96361803e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+29:2402:x1874206965999232:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383370.687520:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383370.687539:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a44 expref: 29 pid: 10098 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.687553:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a44 expref: 29 pid: 10098 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.687589:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16e00/0xc40acec91532f423 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a44 expref: 29 pid: 10098 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.687605:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383370.687610:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f518 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.687632:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.687648:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f518 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383370.687748:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383370.687844:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96361803e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+28:2402:x1874206965999232:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 339us (5731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383370.687854:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 104 00010000:00010000:2.0:1787383370.689521:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689536:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383370.689603:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787383370.689608:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383370.689646:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689674:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689685:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f50a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689692:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f50a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689699:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f50a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689705:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383370.689710:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f50a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689718:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f50a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689732:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:2.0:1787383370.689734:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383370.689739:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f50a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689745:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec91532f50a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689760:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f511 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689794:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f511 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689819:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689825:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383370.689828:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f511 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689835:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f511 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689844:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff963602a66d00) 00010000:00010000:2.0:1787383370.689847:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383370.689850:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f511 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689856:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f511 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689897:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f503 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a83 expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689912:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f518 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a83 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383370.689920:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:2.0:1787383370.689923:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383370.689925:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17400, rc 0) 00000100:00100000:2.0:1787383370.690425:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+27:12469:x1874206965998848:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 25034us (25386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383370.690444:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 249 00000100:00100000:2.0:1787383370.906981:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383370.907006:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984919424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383370.907074:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383370.907192:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984919424 00000100:00100000:1.0:1787383370.907201:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984919424 00000100:00100000:1.0:1787383370.907253:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787383370.907262:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984919424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383370.907294:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383370.907356:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984919424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383370.907363:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787383370.907551:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984919424:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787383371.418939:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787383371.588148:0:14656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787383371.588158:0:14656:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787383371.588190:0:14656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787383371.588196:0:14656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787383371.613988:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383371.613997:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383371.614024:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787383371.614033:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787383371.614168:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504692d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1874206984919552:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787383371.614271:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361aee8300 going to sleep for 11 seconds 00000100:00100000:1.0:1787383371.617241:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504692d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13797:1874206984919552:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787383371.628624:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383371.628842:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965999360 00000100:00100000:0.0:1787383371.628852:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965999360 00000100:00100000:0.0:1787383371.628908:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 250 00000100:00100000:0.0:1787383371.628917:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+27:12480:x1874206965999360:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787383371.628952:0:6521:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787383371.629197:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+27:12480:x1874206965999360:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 279us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383371.629205:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 250 00000100:00100000:2.0:1787383371.635366:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383371.635444:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965999616 00000100:00100000:0.0:1787383371.635454:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965999616 00000100:00100000:0.0:1787383371.635516:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 251 00000100:00100000:0.0:1787383371.635527:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+27:12480:x1874206965999616:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383371.635547:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383371.635580:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f51f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a8a expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383371.635696:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f526 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383371.635712:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383371.635724:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383371.635737:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787383371.635891:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec91532f51f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a8a expref: 30 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383371.635931:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a8a expref: 29 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383371.635940:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383371.635944:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383371.635948:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16600, rc 0) 00000100:00100000:0.0:1787383371.636005:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+29:12480:x1874206965999616:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 479us (649us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787383371.636013:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 251 00000100:00100000:0.0:1787383371.647965:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383371.648019:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383371.648051:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966000000 00000100:00100000:0.0:1787383371.648061:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966000000 00000100:00100000:0.0:1787383371.648120:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:0.0:1787383371.648131:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+29:2404:x1874206966000000:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383371.648146:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383371.648171:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16600/0xc40acec91532f526 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a8a expref: 29 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383371.648188:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:0.0:1787383371.648193:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383371.648250:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+28:2404:x1874206966000000:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 120us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383371.648258:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1787383371.648329:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206965999872 00000100:00100000:3.0:1787383371.648334:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206965999872 00000100:00100000:3.0:1787383371.648372:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 252 00000100:00100000:3.0:1787383371.648380:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+28:12480:x1874206965999872:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787383371.648447:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532f534 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383371.648461:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532f534 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383371.648483:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532f534 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383371.648657:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532f534 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383371.648666:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532f534 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383371.648672:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532f534 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383371.648678:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383371.648682:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532f534 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383371.648690:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532f534 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383371.648698:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:3.0:1787383371.648701:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787383371.648704:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532f534 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383371.648710:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600030a00/0xc40acec91532f534 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383371.648817:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+29:12480:x1874206965999872:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 437us (860us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787383371.648825:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 252 00000040:00080000:3.0:1787383371.648916:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383371.648921:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383371.649362:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787383371.649369:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787383371.656649:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383371.660400:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966000256 00000100:00100000:2.0:1787383371.660417:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966000256 00000100:00100000:2.0:1787383371.660481:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:2.0:1787383371.660493:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+29:12480:x1874206966000256:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787383371.661635:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+30:12480:x1874206966000256:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 1130us (4990us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787383371.661647:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:2.0:1787383371.930940:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984919680:0@lo:400:kworker.0 00000100:00100000:2.0:1787383371.931022:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383371.931228:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984919808:0@lo:400:kworker.0 00000100:00100000:0.0:1787383371.931272:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383371.931315:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984920064:0@lo:400:kworker.0 00000100:00100000:2.0:1787383371.931342:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984920192:0@lo:400:kworker.0 00000100:00100000:3.0:1787383371.931352:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383371.931356:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984920320:0@lo:400:kworker.0 00000100:00100000:2.0:1787383371.931369:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383371.931395:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984920704:0@lo:400:kworker.0 00000100:00100000:0.0:1787383371.931401:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984919936:0@lo:400:kworker.0 00000100:00100000:2.0:1787383371.931433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383371.931441:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383371.931455:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984921216:0@lo:400:kworker.0 00000100:00100000:0.0:1787383371.931475:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984920448:0@lo:400:kworker.0 00000100:00100000:2.0:1787383371.931495:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383371.931513:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984919680 00000100:00100000:0.0:1787383371.931520:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984919680 00000100:00100000:2.0:1787383371.931535:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984920704 00000100:00100000:2.0:1787383371.931540:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984920704 00000100:00100000:2.0:1787383371.931573:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984921216 00000100:00100000:2.0:1787383371.931577:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984921216 00000100:00100000:2.0:1787383371.931607:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787383371.932030:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1874206984920704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383371.932087:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1874206984920704:12345-0@lo:400:kworker.0 Request processed in 472us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383371.932095:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787383371.932112:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787383371.932130:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984921216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383371.932158:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984921216:12345-0@lo:400:kworker.0 Request processed in 40us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383371.932164:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787383371.932200:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984920192 00000100:00100000:2.0:1787383371.932204:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984920192 00000100:00100000:2.0:1787383371.932223:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984919936 00000100:00100000:2.0:1787383371.932226:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984919936 00000100:00100000:2.0:1787383371.932239:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787383371.932244:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984920192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383371.932276:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984920192:12345-0@lo:400:kworker.0 Request processed in 31us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383371.932281:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787383371.932294:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787383371.932300:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984919936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383371.932669:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1787383371.932679:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984919680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383371.932714:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984919680:12345-0@lo:400:kworker.0 Request processed in 38us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383371.932719:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1787383371.932747:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984919936:12345-0@lo:400:kworker.0 Request processed in 445us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383371.932789:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:0.0:1787383371.933041:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383371.933084:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984920192:0@lo:400:kworker.0 00000100:00100000:0.0:1787383371.933093:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984920704:0@lo:400:kworker.0 00000100:00100000:0.0:1787383371.933100:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984921216:0@lo:400:kworker.0 00000100:00100000:0.0:1787383371.933105:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984919680:0@lo:400:kworker.0 00000100:00100000:1.0:1787383371.934434:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984919808 00000100:00100000:1.0:1787383371.934446:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984919808 00000100:00100000:3.0:1787383371.934474:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984920576:0@lo:400:kworker.0 00000100:00100000:2.0:1787383371.934526:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383371.934821:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383371.934843:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984921088:0@lo:400:kworker.0 00000100:00100000:3.0:1787383371.934866:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383371.934994:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984920576 00000100:00100000:3.0:1787383371.934999:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984920576 00000100:00100000:3.0:1787383371.935037:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984921088 00000100:00100000:3.0:1787383371.935041:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984921088 00000100:00100000:3.0:1787383371.935065:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787383371.935073:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984920576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383371.935122:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984920576:12345-0@lo:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383371.935128:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787383371.935142:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787383371.935147:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984921088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383371.935184:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984921088:12345-0@lo:400:kworker.0 Request processed in 36us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383371.935190:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1787383371.935210:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383371.935214:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383371.935257:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984920576:0@lo:400:kworker.0 00000100:00100000:3.0:1787383371.935267:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984921088:0@lo:400:kworker.0 00000100:00100000:2.0:1787383371.935833:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984920960:0@lo:400:kworker.0 00000100:00100000:2.0:1787383371.936156:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383371.936230:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984920064 00000100:00100000:1.0:1787383371.936232:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984920448 00000100:00100000:0.0:1787383371.936236:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984920064 00000100:00100000:1.0:1787383371.936239:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984920448 00000100:00100000:0.0:1787383371.936278:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787383371.936286:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787383371.936290:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984919808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383371.936299:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984920064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383371.936345:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984920064:12345-0@lo:400:kworker.0 Request processed in 51us (4993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383371.936351:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787383371.936364:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787383371.936369:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984920448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383371.936397:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984920448:12345-0@lo:400:kworker.0 Request processed in 29us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383371.936403:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787383371.936419:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984919808:12345-0@lo:400:kworker.0 Request processed in 132us (5145us total) trans 0 rc 0/0 00000100:00080000:1.0:1787383371.936424:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383371.936440:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787383371.936486:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984920064:0@lo:400:kworker.0 00000100:00100000:1.0:1787383371.936608:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984920960 00000100:00100000:1.0:1787383371.936715:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984920960 00000100:00100000:1.0:1787383371.936757:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787383371.936781:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984920960:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787383371.936838:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383371.937040:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383371.937074:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984920832:0@lo:400:kworker.0 00000100:00100000:3.0:1787383371.937103:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383371.937136:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984919808:0@lo:400:kworker.0 00000100:00100000:3.0:1787383371.937155:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984920320 00000100:00100000:3.0:1787383371.937158:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984920320 00000100:00100000:3.0:1787383371.937191:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984920832 00000100:00100000:3.0:1787383371.937194:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984920832 00000100:00100000:3.0:1787383371.937214:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787383371.937219:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984920320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383371.937253:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984920320:12345-0@lo:400:kworker.0 Request processed in 33us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383371.937260:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787383371.937276:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787383371.937282:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984920832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383371.937310:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984920832:12345-0@lo:400:kworker.0 Request processed in 29us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383371.937328:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787383371.937354:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984920320:0@lo:400:kworker.0 00000100:00100000:3.0:1787383371.937363:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984920832:0@lo:400:kworker.0 00000100:00080000:0.0:1787383371.937432:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383371.937758:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984919936:0@lo:400:kworker.0 00010000:00080000:2.0:1787383371.937790:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503ff7b80 x1874206984920448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383371.937948:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984920960:12345-0@lo:400:kworker.0 Request processed in 1184us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383371.938017:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984920448:0@lo:400:kworker.0 00010000:00080000:2.0:1787383371.938032:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503ff4000 x1874206984920960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383371.938041:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984920960:0@lo:400:kworker.0 00000100:00100000:1.0:1787383371.938092:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787383372.443300:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984921344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383372.443328:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984921472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383372.443364:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383372.443416:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383372.448607:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984921344 00000100:00100000:0.0:1787383372.448632:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984921344 00000100:00100000:1.0:1787383372.448704:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984921472 00000100:00100000:1.0:1787383372.448727:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984921472 00000100:00100000:1.0:1787383372.448804:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787383372.448815:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874206984921472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383372.448861:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383372.448912:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787383372.448922:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984921344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383372.448933:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383372.448954:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1874206984921472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (5537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383372.448962:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787383372.449051:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984921344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (5615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383372.449060:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787383372.449063:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984921472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383372.449104:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984921344:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787383372.449141:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383372.955501:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787383372.955526:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984921600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383372.955603:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383372.955699:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984921600 00000100:00100000:0.0:1787383372.955706:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984921600 00000100:00100000:0.0:1787383372.955756:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787383372.955797:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984921600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383372.955830:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787383372.955882:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984921600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383372.955889:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787383372.955963:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984921600:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787383373.147367:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787383373.468329:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984921728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383373.468400:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383373.469246:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984921728 00000100:00100000:0.0:1787383373.469256:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984921728 00000100:00100000:0.0:1787383373.469479:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787383373.469491:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1874206984921728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383373.469520:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00080000:3.0:1787383373.469654:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383373.470456:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1874206984921728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 966us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383373.470467:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787383373.470535:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984921728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787383373.470955:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383373.471081:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984921856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383373.471127:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383373.474099:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984921856 00000100:00100000:3.0:1787383373.474113:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984921856 00000100:00100000:3.0:1787383373.474188:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787383373.474197:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984921856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787383373.474221:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00080000:0.0:1787383373.474874:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383373.484916:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984921856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10710us (13778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383373.484932:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787383373.485697:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984921856:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1787383373.498342:0:14708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787383373.498414:0:14708:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383373.498449:0:14708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787383373.498455:0:14708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787383373.702442:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383373.702520:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966000512 00000100:00100000:1.0:1787383373.702529:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966000512 00000100:00100000:1.0:1787383373.702588:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 253 00000100:00100000:1.0:1787383373.702598:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+30:12502:x1874206966000512:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383373.702631:0:10098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383373.702652:0:10098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c200/0xc40acec91532f53b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a91 expref: -99 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.702755:0:10098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f542 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.702791:0:10098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f542 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.702814:0:10098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f542 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383373.702828:0:10098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000100:00080000:0.0:1787383373.703142:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787383373.703854:0:10098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c200/0xc40acec91532f53b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a91 expref: 33 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.703874:0:10098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f542 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a91 expref: 32 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.703884:0:10098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:1.0:1787383373.703886:0:10098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787383373.703890:0:10098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96360516c000, rc 0) 00000100:00100000:1.0:1787383373.704306:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+32:12502:x1874206966000512:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 1708us (1870us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787383373.704315:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 253 00000100:00100000:0.0:1787383373.708983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383373.709357:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966000640 00000100:00100000:1.0:1787383373.709367:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966000640 00000100:00100000:1.0:1787383373.709421:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 254 00000100:00100000:1.0:1787383373.709432:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+32:12502:x1874206966000640:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:1.0:1787383373.709744:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96360516ca00/0xc40acec91532f550 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.709794:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96360516ca00/0xc40acec91532f550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.709808:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96360516ca00/0xc40acec91532f550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.709857:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96360516ca00/0xc40acec91532f550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.709864:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96360516ca00/0xc40acec91532f550 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.709870:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96360516ca00/0xc40acec91532f550 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.709877:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96360516ca00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383373.709881:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96360516ca00/0xc40acec91532f550 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.709889:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96360516ca00/0xc40acec91532f550 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.709913:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:1.0:1787383373.709917:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383373.709922:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96360516ca00/0xc40acec91532f550 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383373.709928:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96360516ca00/0xc40acec91532f550 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383373.710013:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+32:12502:x1874206966000640:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 582us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383373.710022:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 254 00000040:00080000:3.0:1787383373.722994:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383373.723004:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383373.723025:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787383373.723032:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787383373.803657:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383373.803848:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966000768 00000100:00100000:0.0:1787383373.803858:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966000768 00000100:00100000:0.0:1787383373.803944:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 80 00000100:00100000:0.0:1787383373.803955:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2403:x1874206966000768:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1787383373.803972:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383373.803991:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532f557 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a98 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383373.804030:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a894e49, atime: 0x6a894e49, ctime: 0x6a894e49, blocks: 0x8 00010000:00010000:0.0:1787383373.804047:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1787383373.804051:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383373.804060:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532f557 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a98 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383373.804076:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532f557 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a98 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383373.804088:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17c00, rc 0) 00000100:00100000:0.0:1787383373.804138:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2403:x1874206966000768:12345-192.168.203.2@tcp:101:cat.0 Request processed in 186us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383373.804145:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 80 00000100:00080000:2.0:1787383373.805800:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383373.810366:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383373.810531:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966000896 00000100:00100000:1.0:1787383373.810541:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966000896 00002000:00100000:1.0:1787383373.810594:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff963504691880 x1874206966000896/t0(0) o3->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:159/0 lens 488/0 e 0 to 0 dl 1787383384 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787383373.810626:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963504691880 with x1874206966000896 ext(0->4095) 00002000:00010000:1.0:1787383373.810633:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963504691880 00000100:00100000:1.0:1787383373.810669:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:1.0:1787383373.810678:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2404:x1874206966000896:12345-192.168.203.2@tcp:3:cat.0 00000100:00100000:1.0:1787383373.810989:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2404:x1874206966000896:12345-192.168.203.2@tcp:3:cat.0 Request processed in 310us (630us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787383373.810998:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00002000:00100000:1.0:1787383373.811006:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff963504691880 x1874206966000896/t0(0) o3->a75c5b6d-4c9e-4295-9df6-097efce92717@192.168.203.2@tcp:159/0 lens 488/4536 e 0 to 0 dl 1787383384 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787383373.811014:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff963504691880 with x1874206966000896 ext(0->4095) 00002000:00010000:1.0:1787383373.811018:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff963504691880 00010000:00010000:0.0:1787383374.493215:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383374.901101:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383374.901156:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383374.901193:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383374.901234:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383374.901253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383374.901279:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383374.901324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383374.901365:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966001280 00000100:00100000:0.0:1787383374.901365:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966001024 00000100:00100000:1.0:1787383374.901377:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966001280 00000100:00100000:0.0:1787383374.901377:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966001024 00000100:00100000:1.0:1787383374.901427:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966001792 00000100:00100000:1.0:1787383374.901430:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966001792 00000100:00100000:0.0:1787383374.901433:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 390 00000100:00100000:0.0:1787383374.901443:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2401:x1874206966001024:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383374.901445:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966001152 00000100:00100000:1.0:1787383374.901447:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966001152 00000100:00100000:1.0:1787383374.901457:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966001664 00000100:00100000:1.0:1787383374.901459:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966001664 00000100:00100000:1.0:1787383374.901509:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 329 00000100:00100000:1.0:1787383374.901515:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206966001280:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383374.901530:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2401:x1874206966001024:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 89us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383374.901538:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 390 00000100:00100000:1.0:1787383374.901558:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206966001280:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 43us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383374.901564:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 329 00000100:00100000:0.0:1787383374.901577:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 330 00000100:00100000:1.0:1787383374.901581:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 331 00000100:00100000:0.0:1787383374.901583:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206966001792:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383374.901586:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+32:2401:x1874206966001152:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383374.901621:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a75c5b6d-4c9e-4295-9df6-097efce92717+32:2401:x1874206966001152:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 34us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383374.901622:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206966001792:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 40us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383374.901628:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 331 00000100:00100000:2.0:1787383374.901680:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966001536 00000100:00100000:2.0:1787383374.901685:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966001536 00000100:00100000:2.0:1787383374.901734:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966001408 00000100:00100000:2.0:1787383374.901737:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966001408 00000100:00100000:2.0:1787383374.901760:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 161 00000100:00100000:2.0:1787383374.901814:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206966001536:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383374.901847:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206966001536:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 81us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383374.901853:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 161 00000100:00100000:2.0:1787383374.901869:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 162 00000100:00100000:2.0:1787383374.901875:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2401:x1874206966001408:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383374.901913:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+8:2401:x1874206966001408:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 38us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383374.901919:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 162 00000100:00100000:0.0:1787383374.902800:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 330 00000100:00100000:0.0:1787383374.902836:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 332 00000100:00100000:0.0:1787383374.902851:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206966001664:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383374.902904:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206966001664:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 59us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383374.902911:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 332 00000100:00080000:0.0:1787383374.903145:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383374.903152:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383374.903156:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787383375.515485:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383376.027631:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984921984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383376.027702:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383376.027837:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984921984 00000100:00100000:1.0:1787383376.027853:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984921984 00000100:00100000:1.0:1787383376.027906:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787383376.027916:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984921984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383376.027947:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383376.027998:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984921984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383376.028006:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787383376.028075:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984921984:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1787383376.034126:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1787383376.034165:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9636051f6300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787383376.034171:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963502536300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9636051f6900 00000020:00080000:2.0:1787383376.034174:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963502536c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96350459a600 00000020:00080000:2.0:1787383376.034191:0:6498:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1787383376.034405:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96360516d800/0xc40acec91532f4d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383376.034417:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96360516d800/0xc40acec91532f4d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383376.034425:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96360516d800/0xc40acec91532f4d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383376.034431:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96360516d800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383376.034436:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96360516d800/0xc40acec91532f4d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383376.034444:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96360516d800/0xc40acec91532f4d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383376.034462:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff96350366bb00) 00010000:00010000:0.0:1787383376.034465:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383376.034494:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96360516d800/0xc40acec91532f4d2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383376.034502:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96360516d800/0xc40acec91532f4d2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787383376.035095:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787383376.035171:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1787383376.035728:0:9513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1787383376.035918:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000001:00080000:0.0:1787383376.035926:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00010000:00010000:0.0:1787383376.539047:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383377.056430:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984922112:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.056560:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383377.056629:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984922624:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.056659:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383377.056681:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984923136:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.056706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383377.056725:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984923648:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.056744:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383377.056794:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787383377.056800:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984922240:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.056825:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383377.056842:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984922752:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.056861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383377.056877:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984923264:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.056897:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383377.056939:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984922368:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.056962:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383377.057001:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984922880:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.057022:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383377.057039:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984923392:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.057060:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383377.057081:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787383377.057087:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984922496:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.057108:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383377.057119:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984923008:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.057138:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383377.057157:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984923520:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.057175:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383377.057212:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984922112 00000100:00100000:0.0:1787383377.057222:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984922112 00000100:00100000:0.0:1787383377.057281:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787383377.057291:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984922112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.057353:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3647:x1874206984922112:12345-0@lo:400:kworker.0 Request processed in 63us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383377.057362:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787383377.057418:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984922624 00000100:00100000:0.0:1787383377.057422:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984922624 00000100:00100000:0.0:1787383377.057444:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984922368 00000100:00100000:0.0:1787383377.057447:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984922368 00000100:00100000:0.0:1787383377.057461:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787383377.057467:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984922624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.057503:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984922624:12345-0@lo:400:kworker.0 Request processed in 36us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383377.057519:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787383377.057532:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787383377.057537:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984922368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.057570:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984922368:12345-0@lo:400:kworker.0 Request processed in 32us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383377.057575:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787383377.057607:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984923136 00000100:00100000:0.0:1787383377.057611:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984923136 00000100:00100000:0.0:1787383377.057641:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984923648 00000100:00100000:0.0:1787383377.057645:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984923648 00000100:00100000:0.0:1787383377.057657:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984923008 00000100:00100000:0.0:1787383377.057659:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984923008 00000100:00100000:0.0:1787383377.057671:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984923520 00000100:00100000:0.0:1787383377.057674:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984923520 00000100:00100000:0.0:1787383377.057689:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787383377.057696:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984923136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.057728:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984923136:12345-0@lo:400:kworker.0 Request processed in 32us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383377.057734:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787383377.057745:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787383377.057751:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984923648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.057804:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984923648:12345-0@lo:400:kworker.0 Request processed in 54us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383377.057811:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787383377.057821:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787383377.057826:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984923008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.057865:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984923008:12345-0@lo:400:kworker.0 Request processed in 39us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383377.057871:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787383377.057882:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787383377.057888:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984923520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.057911:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984923520:12345-0@lo:400:kworker.0 Request processed in 24us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383377.057917:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787383377.057941:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984922240 00000100:00100000:0.0:1787383377.057945:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984922240 00000100:00100000:0.0:1787383377.057965:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984922752 00000100:00100000:0.0:1787383377.057968:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984922752 00000100:00100000:0.0:1787383377.057981:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984923264 00000100:00100000:0.0:1787383377.057983:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984923264 00000100:00100000:0.0:1787383377.057994:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984922880 00000100:00100000:0.0:1787383377.057996:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984922880 00000100:00100000:0.0:1787383377.058006:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984923392 00000100:00100000:0.0:1787383377.058008:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984923392 00000100:00100000:0.0:1787383377.058020:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984922496 00000100:00100000:0.0:1787383377.058023:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984922496 00000100:00100000:0.0:1787383377.058035:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787383377.058040:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984922240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058068:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984922240:12345-0@lo:400:kworker.0 Request processed in 28us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383377.058074:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787383377.058086:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787383377.058091:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984922752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058116:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984922752:12345-0@lo:400:kworker.0 Request processed in 25us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383377.058128:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787383377.058139:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787383377.058144:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984923264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058172:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984923264:12345-0@lo:400:kworker.0 Request processed in 28us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383377.058177:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787383377.058188:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787383377.058193:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984922880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058219:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984922880:12345-0@lo:400:kworker.0 Request processed in 26us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383377.058225:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787383377.058234:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787383377.058240:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984923392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058266:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984923392:12345-0@lo:400:kworker.0 Request processed in 26us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383377.058271:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787383377.058281:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787383377.058287:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984922496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058309:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984922496:12345-0@lo:400:kworker.0 Request processed in 23us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383377.058315:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1787383377.058401:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984922240:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058414:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984922752:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058436:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984923264:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058445:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984922112:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058456:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984922624:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058465:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:0.0:1787383377.058471:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9635045b4a80, transno 4294967324 00000004:00080000:0.0:1787383377.058486:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:0.0:1787383377.058510:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984923136:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058521:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1787383377.058524:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96350206b800, transno 4294967311 00000100:00100000:0.0:1787383377.058536:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984923648:0@lo:400:kworker.0 00000100:00080000:0.0:1787383377.058569:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383377.058574:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383377.058577:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383377.058579:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383377.058802:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984922496:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058814:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984923008:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058825:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984923520:0@lo:400:kworker.0 00000100:00100000:0.0:1787383377.058836:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984922368:0@lo:400:kworker.0 00010000:00080000:0.0:1787383377.058851:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350206b100 x1874206984922880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383377.058862:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984922880:0@lo:400:kworker.0 00010000:00080000:0.0:1787383377.058872:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447f800 x1874206984923392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383377.058889:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984923392:0@lo:400:kworker.0 00010000:00010000:0.0:1787383377.563067:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383377.563077:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984923904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383377.563086:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383377.563101:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984923776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383377.566493:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383377.568754:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984923904 00000100:00100000:1.0:1787383377.568788:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984923904 00000100:00100000:1.0:1787383377.568888:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787383377.568901:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984923904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383377.568947:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383377.569061:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984923904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (2576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383377.569097:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787383377.569307:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984923904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383377.572231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383377.572372:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984923776 00000100:00100000:3.0:1787383377.572385:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984923776 00000100:00100000:3.0:1787383377.572452:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787383377.572464:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984923776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383377.572499:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383377.572574:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984923776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383377.572581:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787383377.572936:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984923776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383378.085016:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984924032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383378.085123:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383378.085255:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984924032 00000100:00100000:2.0:1787383378.085266:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984924032 00000100:00100000:2.0:1787383378.085335:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787383378.085346:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984924032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383378.085391:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787383378.085444:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984924032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383378.085451:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787383378.085512:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984924032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383378.587001:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984924160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383378.587095:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383378.587209:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984924160 00000100:00100000:1.0:1787383378.587221:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984924160 00000100:00100000:1.0:1787383378.587367:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787383378.587380:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984924160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383378.587421:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787383378.587477:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984924160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383378.587487:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787383378.587543:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984924160:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787383378.590985:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383378.590999:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383378.591031:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984924288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383378.591120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383378.591602:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984924288 00000100:00100000:3.0:1787383378.591614:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984924288 00000100:00100000:3.0:1787383378.591678:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787383378.591700:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984924288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383378.591734:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787383378.591826:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984924288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383378.591835:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787383378.592459:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984924288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383378.809923:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383378.810111:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966001920 00000100:00100000:2.0:1787383378.810127:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966001920 00000100:00100000:2.0:1787383378.810230:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 255 00000100:00100000:2.0:1787383378.810262:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+18:12155:x1874206966001920:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787383378.810417:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a75c5b6d-4c9e-4295-9df6-097efce92717+18:12155:x1874206966001920:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 Request processed in 158us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383378.810426:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 255 00000100:00080000:0.0:1787383378.810849:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383378.815075:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383378.815220:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966002048 00000100:00100000:2.0:1787383378.815236:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966002048 00000100:00100000:2.0:1787383378.815341:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 256 00000100:00100000:2.0:1787383378.815357:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:12155:x1874206966002048:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1787383378.815575:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383378.815962:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:12155:x1874206966002048:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 Request processed in 608us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383378.815972:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 256 00000100:00100000:3.0:1787383378.832953:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383378.833217:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966002304 00000100:00100000:2.0:1787383378.833231:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966002304 00000100:00100000:2.0:1787383378.833307:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:2.0:1787383378.833319:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+18:12155:x1874206966002304:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787383378.833642:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+19:12155:x1874206966002304:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 323us (701us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787383378.833651:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:3.0:1787383379.071149:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383379.071611:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966002432 00000100:00100000:0.0:1787383379.071625:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966002432 00000100:00100000:0.0:1787383379.071726:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 257 00000100:00080000:2.0:1787383379.071879:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383379.072000:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:12958:x1874206966002432:12345-192.168.203.2@tcp:101:lsof.0 00010000:00010000:0.0:1787383379.072027:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383379.072064:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f55e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402a9f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383379.072153:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f565 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383379.072171:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f565 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383379.072186:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f565 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383379.072272:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787383379.072277:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383379.072307:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f565 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383379.072336:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16200/0xc40acec91532f55e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a9f expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383379.072359:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f565 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a9f expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383379.072372:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635032cd200) 00010000:00010000:0.0:1787383379.072375:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383379.072380:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17800, rc 0) 00000100:00100000:0.0:1787383379.072468:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:12958:x1874206966002432:12345-192.168.203.2@tcp:101:lsof.0 Request processed in 472us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383379.076749:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 257 00010000:00010000:0.0:1787383379.610976:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383380.020490:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383380.020602:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383380.020639:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383380.020667:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383380.020692:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383380.020714:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383380.020749:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383380.020819:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966003072 00000100:00100000:0.0:1787383380.020829:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966003072 00000100:00100000:0.0:1787383380.020906:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966002944 00000100:00100000:0.0:1787383380.020909:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966002944 00000100:00100000:0.0:1787383380.020931:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 167 00000100:00100000:0.0:1787383380.020939:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206966003072:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383380.021009:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206966003072:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 71us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383380.021017:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 167 00000100:00100000:0.0:1787383380.021032:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 168 00000100:00100000:0.0:1787383380.021038:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206966002944:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383380.021060:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2402:x1874206966002944:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383380.021387:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966002816 00000100:00100000:1.0:1787383380.021392:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966002816 00000100:00100000:1.0:1787383380.021426:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966003328 00000100:00100000:1.0:1787383380.021429:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966003328 00000100:00100000:1.0:1787383380.021442:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966002688 00000100:00100000:1.0:1787383380.021444:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966002688 00000100:00100000:1.0:1787383380.021457:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966003200 00000100:00100000:1.0:1787383380.021460:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966003200 00000100:00100000:1.0:1787383380.021476:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 339 00000100:00100000:1.0:1787383380.021482:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206966002816:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383380.021521:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2402:x1874206966002816:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 39us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383380.021528:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 339 00000100:00100000:1.0:1787383380.021543:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 340 00000100:00100000:1.0:1787383380.021549:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206966003328:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383380.021586:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2402:x1874206966003328:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 24us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383380.021593:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 340 00000100:00100000:1.0:1787383380.021605:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 341 00000100:00100000:1.0:1787383380.021611:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+19:2402:x1874206966002688:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383380.021641:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+19:2402:x1874206966002688:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 30us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383380.021646:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 341 00000100:00100000:1.0:1787383380.021658:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 342 00000100:00100000:1.0:1787383380.021665:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2402:x1874206966003200:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383380.021685:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2402:x1874206966003200:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 21us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383380.021692:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 342 00000100:00100000:2.0:1787383380.022048:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966002560 00000100:00100000:2.0:1787383380.022053:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966002560 00000100:00100000:2.0:1787383380.022085:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 392 00000100:00100000:2.0:1787383380.022093:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2402:x1874206966002560:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383380.022123:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2402:x1874206966002560:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 31us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383380.022141:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 392 00000100:00080000:2.0:1787383380.022177:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383380.022182:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383380.022184:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383380.022186:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383380.022658:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 168 00010000:00010000:1.0:1787383380.635237:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383381.147302:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383381.147324:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984924416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383381.147405:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383381.147787:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984924416 00000100:00100000:0.0:1787383381.147795:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984924416 00000100:00100000:0.0:1787383381.147842:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787383381.154222:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984924416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383381.154275:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787383381.154444:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984924416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 262us (7038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383381.154454:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787383381.154631:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984924416:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787383381.659060:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787383382.174989:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1787383382.175008:0:6498:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787383382.175082:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787383382.175092:0:6552:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1787383382.180314:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383382.180342:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984924544:0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.180449:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383382.180479:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984924672:0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.180532:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984924928:0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.180574:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383382.180621:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984925440:0@lo:400:kworker.0 00000100:00100000:1.0:1787383382.180647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383382.180723:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984925056:0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.181507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383382.181532:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984925952:0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.181637:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383382.181681:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984925440 00000100:00100000:0.0:1787383382.181688:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984925440 00000100:00100000:0.0:1787383382.181727:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984925952 00000100:00100000:0.0:1787383382.181728:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984925952 00000100:00100000:0.0:1787383382.181742:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787383382.181748:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984925440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383382.181811:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383382.181824:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984925440:12345-0@lo:400:kworker.0 Request processed in 73us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383382.181833:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787383382.181845:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984925568:0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.181855:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787383382.181864:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984925952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383382.181876:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383382.181895:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984926080:0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.181905:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984925952:12345-0@lo:400:kworker.0 Request processed in 42us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383382.181975:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787383382.181988:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984925568 00000100:00100000:0.0:1787383382.181990:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984925568 00000100:00100000:0.0:1787383382.182008:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787383382.182014:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984925568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.182046:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984925568:12345-0@lo:400:kworker.0 Request processed in 31us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383382.182052:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1787383382.182072:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383382.182076:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383382.182100:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383382.182128:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984925440:0@lo:400:kworker.0 00000100:00100000:2.0:1787383382.182143:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984925568:0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.182147:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984925952:0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.182191:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984925056 00000100:00100000:0.0:1787383382.182195:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984925056 00000100:00100000:0.0:1787383382.182228:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787383382.182232:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984925056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.182272:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984925056:12345-0@lo:400:kworker.0 Request processed in 40us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383382.182276:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787383382.182288:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984926080 00000100:00100000:0.0:1787383382.182290:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984926080 00000100:00100000:0.0:1787383382.182304:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787383382.182307:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984926080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.182325:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984926080:12345-0@lo:400:kworker.0 Request processed in 17us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383382.182328:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1787383382.182335:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383382.182347:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984925056:0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.182353:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984926080:0@lo:400:kworker.0 00000100:00100000:1.0:1787383382.182668:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984925184:0@lo:400:kworker.0 00000100:00100000:2.0:1787383382.183020:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984924928 00000100:00100000:2.0:1787383382.183026:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984924928 00000100:00100000:2.0:1787383382.183068:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984924672 00000100:00100000:2.0:1787383382.183071:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984924672 00000100:00100000:0.0:1787383382.183092:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787383382.183102:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984924928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.183148:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984924928:12345-0@lo:400:kworker.0 Request processed in 47us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383382.183149:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383382.183167:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787383382.183179:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984925184 00000100:00100000:1.0:1787383382.183184:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984925696:0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.183191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787383382.183197:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984925184 00000100:00100000:0.0:1787383382.183216:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984924672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383382.183217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383382.183228:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984925696 00000100:00100000:2.0:1787383382.183233:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984925696 00000100:00100000:1.0:1787383382.183244:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787383382.183255:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984924800:0@lo:400:kworker.0 00000100:00100000:2.0:1787383382.183261:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787383382.183271:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984925184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383382.183287:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383382.183311:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984925312:0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.183317:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984924672:12345-0@lo:400:kworker.0 Request processed in 107us (2669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383382.183324:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984925184:12345-0@lo:400:kworker.0 Request processed in 52us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383382.183326:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1787383382.183343:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383382.183343:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1787383382.183355:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984925696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383382.183359:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787383382.183365:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984925824:0@lo:400:kworker.0 00000100:00100000:2.0:1787383382.183381:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984925312 00000100:00100000:2.0:1787383382.183386:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984925312 00000100:00100000:1.0:1787383382.183401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383382.183406:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984925696:12345-0@lo:400:kworker.0 Request processed in 50us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383382.183409:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984925824 00000100:00100000:2.0:1787383382.183414:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984925824 00000100:00100000:0.0:1787383382.183417:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1787383382.183432:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984924672:0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.183441:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1787383382.183448:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984925184:0@lo:400:kworker.0 00000100:00100000:2.0:1787383382.183455:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1787383382.183455:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984925312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383382.183464:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984925696:0@lo:400:kworker.0 00000100:00100000:2.0:1787383382.183471:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984925824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.183499:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984925312:12345-0@lo:400:kworker.0 Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383382.183507:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1787383382.183536:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984924928:0@lo:400:kworker.0 00010000:00080000:1.0:1787383382.183618:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503ff4700 x1874206984925312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383382.183630:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984925312:0@lo:400:kworker.0 00000100:00100000:2.0:1787383382.183653:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984925824:12345-0@lo:400:kworker.0 Request processed in 186us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383382.183661:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00080000:0.0:1787383382.183748:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383382.183753:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383382.183793:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984924800 00000100:00100000:0.0:1787383382.183798:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984924800 00000100:00100000:0.0:1787383382.183830:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787383382.183838:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984924800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383382.183876:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984924800:12345-0@lo:400:kworker.0 Request processed in 40us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383382.183882:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787383382.185879:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984924544 00000100:00100000:2.0:1787383382.185895:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984924544 00000100:00100000:2.0:1787383382.186163:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1787383382.186175:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984924544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383382.186318:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984924544:12345-0@lo:400:kworker.0 Request processed in 145us (5883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383382.186326:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1787383382.186363:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984924544:0@lo:400:kworker.0 00010000:00080000:1.0:1787383382.196846:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963608cf9180 x1874206984925824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383382.196866:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984925824:0@lo:400:kworker.0 00000100:00100000:3.0:1787383382.196967:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984924800:0@lo:400:kworker.0 00000001:02000400:0.0:1787383382.563215:0:14906:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:23:01 (1787383381) 00010000:00010000:0.0:1787383382.683152:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383382.683209:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984926208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383382.683276:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383382.683871:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383382.683882:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984926336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383382.683913:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383382.683942:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984926208 00000100:00100000:3.0:1787383382.683949:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984926208 00000100:00100000:3.0:1787383382.683988:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984926336 00000100:00100000:3.0:1787383382.683992:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984926336 00000100:00100000:3.0:1787383382.684007:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787383382.684015:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984926208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383382.684045:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383382.684087:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984926208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383382.684095:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787383382.684128:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787383382.684134:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984926336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383382.684144:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383382.684169:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984926336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383382.684175:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787383382.684214:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984926336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383382.684230:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984926208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383383.195287:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787383383.195337:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984926464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383383.195439:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383383.195570:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984926464 00000100:00100000:1.0:1787383383.195582:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984926464 00000100:00100000:1.0:1787383383.195642:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787383383.195653:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984926464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383383.195699:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787383383.195754:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984926464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383383.195762:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787383383.195851:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984926464:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787383383.387896:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787383383.706962:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383383.710424:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984926592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383383.710520:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383383.710632:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984926592 00000100:00100000:2.0:1787383383.710641:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984926592 00000100:00100000:2.0:1787383383.710712:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787383383.710723:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984926592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787383383.710761:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787383383.710833:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984926592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383383.710860:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787383383.710914:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984926592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383383.710948:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383383.710960:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984926720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383383.710996:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383383.711439:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984926720 00000100:00100000:2.0:1787383383.711446:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984926720 00000100:00100000:2.0:1787383383.711485:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787383383.711493:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984926720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383383.711507:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787383383.711558:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984926720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383383.711565:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787383383.716250:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984926720:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787383383.976478:0:13797:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787383383.976508:0:13797:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383383.976653:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787383383.976665:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787383384.736872:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383385.157012:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383385.157062:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383385.157094:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383385.157124:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383385.157145:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383385.157166:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383385.157429:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966003456 00000100:00100000:2.0:1787383385.157443:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966003456 00000100:00100000:2.0:1787383385.157516:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 394 00000100:00100000:2.0:1787383385.157529:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2401:x1874206966003456:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383385.157625:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2401:x1874206966003456:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 99us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383385.157634:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 394 00000100:00100000:0.0:1787383385.157879:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966003712 00000100:00100000:0.0:1787383385.157885:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966003712 00000100:00100000:0.0:1787383385.157937:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966004224 00000100:00100000:0.0:1787383385.157941:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966004224 00000100:00100000:0.0:1787383385.157966:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966003584 00000100:00100000:0.0:1787383385.157969:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966003584 00000100:00100000:0.0:1787383385.157990:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 349 00000100:00100000:0.0:1787383385.157997:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206966003712:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383385.158036:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206966003712:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 40us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383385.158042:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 349 00000100:00100000:0.0:1787383385.158056:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 350 00000100:00100000:0.0:1787383385.158062:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206966004224:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383385.158086:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2401:x1874206966004224:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 24us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383385.158093:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 350 00000100:00100000:0.0:1787383385.158104:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 351 00000100:00100000:0.0:1787383385.158111:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+18:2401:x1874206966003584:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383385.158134:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+18:2401:x1874206966003584:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 24us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383385.158140:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 351 00000100:00100000:1.0:1787383385.158268:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383385.158301:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966003968 00000100:00100000:1.0:1787383385.158305:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966003968 00000100:00100000:1.0:1787383385.158337:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966003840 00000100:00100000:1.0:1787383385.158340:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966003840 00000100:00100000:1.0:1787383385.158359:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 173 00000100:00100000:1.0:1787383385.158365:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206966003968:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383385.158390:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2401:x1874206966003968:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383385.158544:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 173 00000100:00100000:1.0:1787383385.158562:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 174 00000100:00100000:1.0:1787383385.158570:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206966003840:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383385.158608:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2401:x1874206966003840:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 39us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383385.158614:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 174 00000100:00100000:1.0:1787383385.158633:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966004096 00000100:00100000:1.0:1787383385.158636:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966004096 00000100:00100000:1.0:1787383385.158663:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 352 00000100:00100000:1.0:1787383385.158669:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2401:x1874206966004096:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383385.158692:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2401:x1874206966004096:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 24us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383385.158698:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 352 00000100:00080000:2.0:1787383385.159639:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383385.159649:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383385.159652:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383385.159655:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787383385.755333:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383386.271636:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383386.271669:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984926848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383386.271786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383386.272436:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984926848 00000100:00100000:1.0:1787383386.272449:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984926848 00000100:00100000:1.0:1787383386.272537:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787383386.272548:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984926848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383386.272592:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383386.272664:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984926848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383386.272673:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787383386.272814:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984926848:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787383386.783507:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383387.136699:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383387.136816:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966004480 00000100:00100000:1.0:1787383387.136827:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966004480 00000100:00080000:2.0:1787383387.137445:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383387.137495:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:1.0:1787383387.137508:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+18:13182:x1874206966004480:12345-192.168.203.2@tcp:35:umount.0 00000100:00100000:1.0:1787383387.137803:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+19:13182:x1874206966004480:12345-192.168.203.2@tcp:35:umount.0 Request processed in 261us (1076us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787383387.137813:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:0.0:1787383387.142573:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383387.142657:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966004736 00000100:00100000:1.0:1787383387.142666:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966004736 00000100:00100000:1.0:1787383387.142748:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:1.0:1787383387.142758:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+19:13182:x1874206966004736:12345-192.168.203.2@tcp:35:umount.0 00000100:00100000:1.0:1787383387.143064:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a75c5b6d-4c9e-4295-9df6-097efce92717+20:13182:x1874206966004736:12345-192.168.203.2@tcp:35:umount.0 Request processed in 306us (498us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787383387.143072:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:0.0:1787383387.148381:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383387.148453:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966004992 00000100:00100000:3.0:1787383387.148463:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966004992 00000100:00100000:3.0:1787383387.148509:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:3.0:1787383387.148517:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628e58850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+20:13182:x1874206966004992:12345-192.168.203.2@tcp:35:umount.0 00000100:00100000:3.0:1787383387.148809:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628e58850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+21:13182:x1874206966004992:12345-192.168.203.2@tcp:35:umount.0 Request processed in 291us (437us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787383387.148817:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:0.0:1787383387.154922:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383387.155095:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966005248 00000100:00100000:3.0:1787383387.155108:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966005248 00000100:00100000:3.0:1787383387.155192:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:3.0:1787383387.155231:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+21:13182:x1874206966005248:12345-192.168.203.2@tcp:35:umount.0 00000100:00100000:3.0:1787383387.155963:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+22:13182:x1874206966005248:12345-192.168.203.2@tcp:35:umount.0 Request processed in 733us (1062us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787383387.155974:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:0.0:1787383387.161737:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383387.161882:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966005376 00000100:00100000:2.0:1787383387.161926:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966005376 00000100:00100000:2.0:1787383387.161999:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:2.0:1787383387.162009:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2403:x1874206966005376:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383387.162025:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383387.162043:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636013fce00/0xc40acec91532e53c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025f2 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.162061:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383387.162138:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:2403:x1874206966005376:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 130us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383387.162146:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:0.0:1787383387.167093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383387.167153:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383387.167292:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966005504 00000100:00100000:2.0:1787383387.167310:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966005504 00000100:00100000:2.0:1787383387.167392:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966005632 00000100:00100000:2.0:1787383387.167397:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966005632 00000100:00100000:2.0:1787383387.167435:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:2.0:1787383387.167446:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bbc500f-638e-4719-909d-90fd49cd1aa8+13:2402:x1874206966005504:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383387.167464:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383387.167484:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b7000/0xc40acec91532e47f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025b3 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.167502:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383387.167579:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:2402:x1874206966005504:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 135us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383387.167589:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:2.0:1787383387.167611:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:2.0:1787383387.167618:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:2402:x1874206966005632:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383387.167640:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383387.167651:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c1a00/0xc40acec91532e757 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026cb expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.167662:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383387.167681:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2402:x1874206966005632:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 64us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383387.167687:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:0.0:1787383387.170763:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383387.170951:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966005760 00000100:00100000:1.0:1787383387.170964:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966005760 00000100:00100000:1.0:1787383387.171084:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 81 00000100:00100000:1.0:1787383387.171096:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2400:x1874206966005760:12345-192.168.203.2@tcp:9:umount.0 00000020:00000080:1.0:1787383387.171140:0:8434:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e85a 00000100:00080000:1.0:1787383387.171152:0:8434:0:(import.c:65:import_set_state_nolock()) ffff96363f98c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787383387.171666:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787383387.171928:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+2:2400:x1874206966005760:12345-192.168.203.2@tcp:9:umount.0 Request processed in 832us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383387.171939:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 81 00010000:00010000:1.0:1787383387.171970:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787383387.172814:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383387.190331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383387.190543:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966006144 00000100:00100000:1.0:1787383387.190556:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966006144 00000100:00100000:1.0:1787383387.190645:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 82 00000100:00100000:1.0:1787383387.190655:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+7:2400:x1874206966006144:12345-192.168.203.2@tcp:9:umount.0 00000020:00000080:1.0:1787383387.190695:0:8914:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532ead0 00000020:00010000:1.0:1787383387.190705:0:8914:0:(genops.c:1942:obd_stale_export_put()) Put export ffff963503114800: total 0 00000100:00080000:1.0:1787383387.190711:0:8914:0:(import.c:65:import_set_state_nolock()) ffff963503110800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787383387.190821:0:8914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1787383387.191031:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2400:x1874206966006144:12345-192.168.203.2@tcp:9:umount.0 Request processed in 367us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383387.191068:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 82 00000020:00010000:3.0:1787383387.191223:0:6508:0:(genops.c:1928:obd_stale_export_get()) Get export ffff963503114800: total 0 00010000:00010000:3.0:1787383387.191276:0:6508:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff963503114800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787383387.191348:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532f557 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a98 expref: 4 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.191402:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec91532ee88 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028b5 expref: 3 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383387.191418:0:6508:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff963503114800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787383387.191432:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383387.191434:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383387.191436:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787383387.192214:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383387.204195:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383387.209814:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966007168 00000100:00100000:0.0:1787383387.209837:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966007168 00000100:00100000:0.0:1787383387.209947:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 258 00000100:00100000:0.0:1787383387.209960:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+22:2400:x1874206966007168:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:0.0:1787383387.210007:0:6520:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e48d 00000020:00010000:0.0:1787383387.210037:0:6520:0:(genops.c:1942:obd_stale_export_put()) Put export ffff963503165000: total 0 00000100:00080000:0.0:1787383387.210043:0:6520:0:(import.c:65:import_set_state_nolock()) ffff963503164000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787383387.210092:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1787383387.210388:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a75c5b6d-4c9e-4295-9df6-097efce92717+21:2400:x1874206966007168:12345-192.168.203.2@tcp:39:umount.0 Request processed in 430us (6214us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1787383387.210398:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 258 00000020:00010000:2.0:1787383387.212092:0:6507:0:(genops.c:1928:obd_stale_export_get()) Get export ffff963503165000: total 0 00010000:00010000:2.0:1787383387.212112:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383387.212224:0:6507:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff963503165000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787383387.212279:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:2.0:1787383387.212284:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787383387.212301:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532ee73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028ae expref: 20 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.212329:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:2.0:1787383387.212332:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787383387.212337:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7000/0xc40acec91532eb2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34027ce expref: 19 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.212353:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628fc9400) 00010000:00010000:2.0:1787383387.212355:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383387.212372:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8800/0xc40acec91532e7d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026e0 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.212422:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:2.0:1787383387.212425:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383387.212430:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532f438 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a4b expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.212444:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:2.0:1787383387.212447:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787383387.212452:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17200/0xc40acec91532ef0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028d8 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.212477:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:2.0:1787383387.212479:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383387.212482:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec91532ed69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402868 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.212756:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:2.0:1787383387.212759:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383387.212833:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17400/0xc40acec91532f518 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a83 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.212851:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff963628fc9000) 00010000:00010000:2.0:1787383387.212853:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383387.212858:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8600/0xc40acec91532e7b9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026d9 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.212874:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635032cd200) 00010000:00010000:2.0:1787383387.212877:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383387.212889:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec91532eef1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028d1 expref: 12 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.212905:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff96350366bd00) 00010000:00010000:2.0:1787383387.212907:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787383387.212911:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96360516c000/0xc40acec91532f542 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a91 expref: 11 pid: 10098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.212928:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff963628fc9f00) 00010000:00010000:2.0:1787383387.212930:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787383387.212934:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9800/0xc40acec91532e830 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026f5 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.212948:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9635032cd000) 00010000:00010000:2.0:1787383387.212950:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383387.212954:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963600031400/0xc40acec91532ee49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34028a0 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.212970:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff96363d897000) 00010000:00010000:2.0:1787383387.212973:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787383387.212976:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532f1fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34029b1 expref: 8 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383387.212993:0:6507:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff963503165000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787383387.213021:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383387.213024:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383387.213025:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383387.223641:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383387.228053:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966007296 00000100:00100000:1.0:1787383387.228077:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966007296 00000100:00080000:2.0:1787383387.228285:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383387.231120:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 259 00000100:00100000:1.0:1787383387.231160:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+5:2400:x1874206966007296:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:1.0:1787383387.231279:0:9499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e494 00000100:00080000:1.0:1787383387.231316:0:9499:0:(import.c:65:import_set_state_nolock()) ffff96363f9b7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787383387.233023:0:9499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787383387.233309:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a75c5b6d-4c9e-4295-9df6-097efce92717+3:2400:x1874206966007296:12345-192.168.203.2@tcp:39:umount.0 Request processed in 2166us (9677us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787383387.233323:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 259 00010000:00010000:3.0:1787383387.245198:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383387.293312:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984926976:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.293445:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.293533:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984927488:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.293565:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.293589:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984928000:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.293614:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.293632:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984928512:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.293653:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.293681:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787383387.293688:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984927104:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.293713:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.293731:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984927616:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.293750:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.293805:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984928128:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.293825:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.293877:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984926976 00000100:00100000:2.0:1787383387.293885:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984926976 00000100:00100000:2.0:1787383387.293935:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1787383387.293944:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984926976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.293996:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984926976:12345-0@lo:400:kworker.0 Request processed in 54us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383387.294005:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1787383387.294043:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984927104 00000100:00100000:2.0:1787383387.294046:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984927104 00000100:00100000:2.0:1787383387.294069:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984927616 00000100:00100000:2.0:1787383387.294071:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984927616 00000100:00100000:2.0:1787383387.294093:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984928128 00000100:00100000:2.0:1787383387.294104:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984928128 00000100:00100000:2.0:1787383387.294119:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787383387.294125:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984927104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294154:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984927104:12345-0@lo:400:kworker.0 Request processed in 29us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383387.294159:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787383387.294168:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787383387.294186:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984927616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294210:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984927616:12345-0@lo:400:kworker.0 Request processed in 36us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383387.294215:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787383387.294225:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787383387.294230:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984928128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294253:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984928128:12345-0@lo:400:kworker.0 Request processed in 23us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383387.294259:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00080000:2.0:1787383387.294282:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383387.294310:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984927488 00000100:00100000:2.0:1787383387.294312:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984927488 00000100:00100000:2.0:1787383387.294341:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787383387.294347:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984927488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294382:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984927488:12345-0@lo:400:kworker.0 Request processed in 35us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383387.294388:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787383387.294436:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984927104:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294448:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984927616:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294465:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984928128:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294474:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984926976:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294484:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984927488:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294556:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984927360:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383387.294591:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984927232:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294608:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984927872:0@lo:400:kworker.0 00000100:00100000:0.0:1787383387.294622:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.294628:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.294643:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984928384:0@lo:400:kworker.0 00000100:00100000:0.0:1787383387.294643:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984927744:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294661:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383387.294685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.294692:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984928000 00000100:00100000:2.0:1787383387.294695:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984928000 00000100:00100000:0.0:1787383387.294710:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984928256:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294720:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984928512 00000100:00100000:2.0:1787383387.294723:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984928512 00000100:00100000:0.0:1787383387.294733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383387.294734:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984927872 00000100:00100000:2.0:1787383387.294736:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984927872 00000100:00100000:2.0:1787383387.294747:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984928384 00000100:00100000:2.0:1787383387.294750:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984928384 00000100:00100000:0.0:1787383387.294757:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984927360 00000100:00100000:0.0:1787383387.294759:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984927360 00000100:00100000:2.0:1787383387.294762:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787383387.294791:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984928000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383387.294807:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984927744 00000100:00100000:0.0:1787383387.294810:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984927744 00000100:00100000:0.0:1787383387.294824:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984928256 00000100:00100000:2.0:1787383387.294826:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984928000:12345-0@lo:400:kworker.0 Request processed in 36us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383387.294826:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984928256 00000100:00100000:2.0:1787383387.294832:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787383387.294839:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787383387.294842:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787383387.294845:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984927360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294846:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984928512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294872:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984928512:12345-0@lo:400:kworker.0 Request processed in 25us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383387.294874:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984927360:12345-0@lo:400:kworker.0 Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383387.294881:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787383387.294883:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787383387.294893:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787383387.294893:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787383387.294899:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984927872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383387.294899:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984927744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294923:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984927872:12345-0@lo:400:kworker.0 Request processed in 25us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383387.294925:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984927744:12345-0@lo:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383387.294929:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787383387.294931:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787383387.294939:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787383387.294940:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787383387.294944:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984928384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383387.294945:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984928256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.294967:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984928384:12345-0@lo:400:kworker.0 Request processed in 23us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383387.294967:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984928256:12345-0@lo:400:kworker.0 Request processed in 21us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383387.294974:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787383387.294974:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00080000:2.0:1787383387.294986:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383387.294990:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383387.294992:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383387.295006:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984927360:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.295015:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984927872:0@lo:400:kworker.0 00010000:00080000:0.0:1787383387.295020:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f68380 x1874206984927744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383387.295024:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984928384:0@lo:400:kworker.0 00000100:00100000:0.0:1787383387.295044:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984927744:0@lo:400:kworker.0 00000100:00100000:2.0:1787383387.295049:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984928000:0@lo:400:kworker.0 00010000:00080000:0.0:1787383387.295055:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f68a80 x1874206984928256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383387.295059:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984928512:0@lo:400:kworker.0 00000100:00100000:0.0:1787383387.295063:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984928256:0@lo:400:kworker.0 00000100:00100000:0.0:1787383387.295080:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984927232 00000100:00100000:0.0:1787383387.295083:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984927232 00000100:00100000:0.0:1787383387.295104:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787383387.295109:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984927232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383387.295141:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984927232:12345-0@lo:400:kworker.0 Request processed in 31us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383387.295209:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984927232:0@lo:400:kworker.0 00000100:00100000:0.0:1787383387.308133:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00010000:2.0:1787383387.803828:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383387.805723:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984928640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383387.805846:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383387.806002:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984928640 00000100:00100000:1.0:1787383387.806014:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984928640 00000100:00100000:1.0:1787383387.806089:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787383387.806100:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984928640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787383387.806141:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383387.806204:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984928640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383387.806213:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787383387.806277:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984928640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383387.806539:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383387.806572:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984928768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383387.806605:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383387.806706:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984928768 00000100:00100000:0.0:1787383387.806712:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984928768 00000100:00100000:0.0:1787383387.806751:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787383387.806759:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984928768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383387.806802:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383387.806843:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984928768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383387.806850:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787383387.806885:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984928768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383388.315450:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984928896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383388.315557:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383388.315717:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984928896 00000100:00100000:3.0:1787383388.315727:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984928896 00000100:00100000:3.0:1787383388.315806:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787383388.315817:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984928896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787383388.315860:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787383388.315920:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984928896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383388.315928:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787383388.316257:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984928896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383388.827391:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984929024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383388.827501:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383388.827656:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984929024 00000100:00100000:2.0:1787383388.827668:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984929024 00000100:00100000:2.0:1787383388.827742:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787383388.827756:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984929024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383388.827839:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787383388.827908:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984929024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383388.827916:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787383388.827969:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984929024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383388.828269:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984929152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383388.828308:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383388.828473:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984929152 00000100:00100000:0.0:1787383388.828484:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984929152 00000100:00100000:0.0:1787383388.828560:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787383388.828572:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984929152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787383388.828593:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787383388.828654:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984929152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383388.828664:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00010000:00010000:3.0:1787383388.828981:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383388.829120:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984929152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383389.478925:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383389.478984:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383389.479029:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383389.479193:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966007424 00000100:00100000:0.0:1787383389.479206:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966007424 00000100:00100000:0.0:1787383389.479284:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966007680 00000100:00100000:0.0:1787383389.479287:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966007680 00000100:00100000:0.0:1787383389.479311:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966007552 00000100:00100000:0.0:1787383389.479314:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966007552 00000100:00100000:0.0:1787383389.479334:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:0.0:1787383389.479346:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+12:2404:x1874206966007424:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383389.479371:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383389.479399:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963601654000/0xc40acec91532e590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402607 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383389.479424:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383389.479490:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+11:2404:x1874206966007424:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 145us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383389.479499:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:0.0:1787383389.479528:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:0.0:1787383389.479535:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+10:2404:x1874206966007680:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383389.479543:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383389.479571:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c1c00/0xc40acec91532e750 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34026c4 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383389.479581:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383389.479601:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+9:2404:x1874206966007680:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 67us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383389.479608:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:0.0:1787383389.479619:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:0.0:1787383389.479626:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96361803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+8:2404:x1874206966007552:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383389.479634:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383389.479642:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b6400/0xc40acec91532e597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402638 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383389.479652:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383389.479667:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96361803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6bbc500f-638e-4719-909d-90fd49cd1aa8+7:2404:x1874206966007552:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 42us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383389.479674:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:0.0:1787383389.490030:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383389.491593:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966007936 00000100:00100000:2.0:1787383389.491616:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966007936 00000100:00080000:0.0:1787383389.491813:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383389.491978:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 260 00000100:00100000:2.0:1787383389.491992:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+6:2400:x1874206966007936:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:2.0:1787383389.492052:0:6521:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e5a5 00000020:00010000:2.0:1787383389.492063:0:6521:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96363f933800: total 0 00000100:00080000:2.0:1787383389.492068:0:6521:0:(import.c:65:import_set_state_nolock()) ffff96363f936800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787383389.492105:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:1.0:1787383389.492218:0:6507:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96363f933800: total 0 00010000:00010000:1.0:1787383389.492293:0:6507:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96363f933800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787383389.492336:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635032cd200) 00010000:00010000:1.0:1787383389.492340:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383389.492350:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec91532f565 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402a9f expref: 5 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383389.492358:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2400:x1874206966007936:12345-192.168.203.2@tcp:39:umount.0 Request processed in 370us (2343us total) trans 4294967528 rc 0/0 00010000:00010000:1.0:1787383389.492378:0:6507:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96363f933800, canceled 1 locks, left on hash table 0. 00000100:00100000:2.0:1787383389.492386:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 260 00010000:00010000:1.0:1787383389.492391:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383389.492393:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383389.492395:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787383389.496524:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f43e303e-1cf9-4e4a-9e69-93ff23e31c78 00000001:00080000:0.0:1787383389.496547:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1787383389.496556:0:6498:0:(genops.c:906:class_export_put()) final put ffff96363f933800/f43e303e-1cf9-4e4a-9e69-93ff23e31c78 00000001:00100000:0.0:1787383389.496580:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000001:00080000:0.0:1787383389.496586:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1787383389.496603:0:6498:0:(genops.c:906:class_export_put()) final put ffff963503165000/a75c5b6d-4c9e-4295-9df6-097efce92717 00000020:00000080:1.0:1787383389.496750:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96363f933800/f43e303e-1cf9-4e4a-9e69-93ff23e31c78 for lustre-MDT0000 00000020:00000080:1.0:1787383389.496841:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963503165000/a75c5b6d-4c9e-4295-9df6-097efce92717 for lustre-MDT0000 00000020:00000080:1.0:1787383389.501500:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363f936800 for lustre-MDT0000 00000020:00000080:1.0:1787383389.501530:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963503164000 for lustre-MDT0000 00000100:00100000:0.0:1787383389.504397:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383389.505189:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966008064 00000100:00100000:2.0:1787383389.505205:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966008064 00000100:00100000:2.0:1787383389.505302:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 261 00000100:00100000:2.0:1787383389.505315:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+5:2400:x1874206966008064:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:2.0:1787383389.505370:0:6522:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e5ac 00000100:00080000:2.0:1787383389.505381:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9635034f0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787383389.505414:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787383389.505654:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f43e303e-1cf9-4e4a-9e69-93ff23e31c78+3:2400:x1874206966008064:12345-192.168.203.2@tcp:39:umount.0 Request processed in 340us (1266us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787383389.505664:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 261 00010000:00010000:3.0:1787383389.505673:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787383389.506189:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383389.536948:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383389.539284:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966008320 00000100:00100000:0.0:1787383389.539330:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966008320 00000100:00100000:0.0:1787383389.539411:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 396 00000100:00100000:0.0:1787383389.539424:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+7:2400:x1874206966008320:12345-192.168.203.2@tcp:251:umount.0 00000020:00000080:0.0:1787383389.540614:0:6514:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e46a 00000020:00010000:0.0:1787383389.540633:0:6514:0:(genops.c:1942:obd_stale_export_put()) Put export ffff963503160000: total 0 00000100:00080000:0.0:1787383389.540639:0:6514:0:(import.c:65:import_set_state_nolock()) ffff963503163800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787383389.541226:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6bbc500f-638e-4719-909d-90fd49cd1aa8+3:2400:x1874206966008320:12345-192.168.203.2@tcp:251:umount.0 Request processed in 1795us (4287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383389.541240:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 396 00000020:00010000:1.0:1787383389.542971:0:6507:0:(genops.c:1928:obd_stale_export_get()) Get export ffff963503160000: total 0 00010000:00010000:1.0:1787383389.542985:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383389.543072:0:6507:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff963503160000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787383389.543123:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b6200/0xc40acec91532e543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f34025f9 expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383389.543153:0:6507:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff963503160000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787383389.543166:0:6507:0:(genops.c:906:class_export_put()) final put ffff963503160000/6bbc500f-638e-4719-909d-90fd49cd1aa8 00010000:00010000:1.0:1787383389.543189:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383389.543192:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383389.543194:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787383389.543289:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963503160000/6bbc500f-638e-4719-909d-90fd49cd1aa8 for MGS 00000020:00000080:3.0:1787383389.543341:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963503163800 for MGS 00010000:00010000:1.0:1787383389.851816:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383390.880118:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383391.387165:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984929280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383391.387255:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383391.387450:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984929280 00000100:00100000:1.0:1787383391.387458:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984929280 00000100:00100000:1.0:1787383391.387519:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787383391.387530:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984929280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383391.387567:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787383391.387632:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984929280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383391.387640:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787383391.387686:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984929280:0@lo:41:osp-pre-1-0.0 00000020:01000004:2.0:1787383391.675930:0:15103:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787383391.697298:0:15103:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787383391.697367:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.697386:0:15103:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.697394:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.697402:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.697424:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787383391.697429:0:15103:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787383391.697455:0:15103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787383391.697471:0:15103:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787383391.697476:0:15103:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787383391.697508:0:15103:0:(import.c:65:import_set_state_nolock()) ffff963640923800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787383391.697533:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383391.697542:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.697551:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7a00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383391.697555:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.697564:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383391.697572:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383391.697578:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787383391.697580:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787383391.697583:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787383391.697610:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.697616:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383391.697649:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.697657:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b7a00/0xc40acec91532e512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e519 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.697668:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383391.697671:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383391.697673:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383391.697687:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984929536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383391.697727:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984929408:0@lo:39:umount.0 00000100:00100000:2.0:1787383391.697750:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383391.697931:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984929536 00000100:00100000:1.0:1787383391.697938:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984929536 00000100:00100000:1.0:1787383391.697991:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787383391.698003:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+24:3648:x1874206984929536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383391.698016:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383391.698032:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac9e00/0xc40acec91532e519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e512 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.698046:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383391.698086:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68140aec-1198-480f-b348-a4187c7bb1d1+23:3648:x1874206984929536:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383391.698093:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787383391.698167:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984929536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383391.698539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383391.699023:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984929408 00000100:00100000:1.0:1787383391.699029:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984929408 00000100:00100000:1.0:1787383391.699078:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787383391.699088:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874206984929408:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787383391.699114:0:6520:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e08f 00000100:00080000:1.0:1787383391.699122:0:6520:0:(import.c:65:import_set_state_nolock()) ffff96363506a000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787383391.699245:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1874206984929408:12345-0@lo:39:umount.0 Request processed in 158us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383391.699265:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1787383391.699286:0:6520:0:(genops.c:906:class_export_put()) final put ffff963635068000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787383391.699322:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963635068000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787383391.699384:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363506a000 for lustre-MDT0000 00000100:00080000:1.0:1787383391.699420:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963640923800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787383391.699431:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984929408:0@lo:39:umount.0 00000100:00080000:0.0:1787383391.699841:0:15103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787383391.699846:0:15103:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787383391.699851:0:15103:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787383391.699945:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383391.701750:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.701951:0:15103:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.701960:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.701968:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.702459:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383391.702470:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.702478:0:15103:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.702484:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.702511:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.702586:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383391.702594:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.702601:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1200 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383391.702605:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.702614:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383391.702621:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383391.702626:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787383391.702629:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787383391.702660:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.702667:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787383391.702721:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984929664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383391.702802:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383391.702887:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.702906:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c1200/0xc40acec91532e520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e527 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.702918:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383391.702921:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.702927:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0a00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383391.702931:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.702937:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383391.702943:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383391.702949:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787383391.702951:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787383391.702967:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.702973:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383391.703083:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:1.0:1787383391.703088:0:15103:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787383391.703097:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.703105:0:15103:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.703111:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.703117:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.703125:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383391.703131:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b6600/0xc40acec91532dfe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.703137:0:15103:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b6600/0xc40acec91532dfe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.703142:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b6600/0xc40acec91532dfe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.703148:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636102b6600/0xc40acec91532dfe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383391.703166:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787383391.703169:0:15103:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787383391.703173:0:15103:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787383391.703223:0:15103:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787383391.703227:0:15103:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787383391.703231:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383391.703236:0:15103:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:1.0:1787383391.703241:0:15103:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff963503114000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787383391.703247:0:15103:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff963502339000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787383391.703252:0:15103:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff963638add800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787383391.703256:0:15103:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff963640946000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1787383391.703261:0:15103:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9636345acd40) has exports, disconnecting them 00000020:00080000:1.0:1787383391.703264:0:15103:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff963503114000), last request at 1787383387 00000020:00000080:1.0:1787383391.703271:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e391 00000100:00080000:1.0:1787383391.703298:0:15103:0:(import.c:65:import_set_state_nolock()) ffff963503117800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787383391.703361:0:15103:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff963503114000): rc 0 00000020:00000080:1.0:1787383391.703363:0:15103:0:(genops.c:906:class_export_put()) final put ffff963503114000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787383391.703373:0:15103:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff963502339000), last request at 1787383387 00000020:00000080:1.0:1787383391.703376:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e26b 00000100:00080000:1.0:1787383391.703381:0:15103:0:(import.c:65:import_set_state_nolock()) ffff96350233d800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787383391.703390:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963503114000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787383391.703427:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963503117800 for lustre-MDT0000 00000020:00080000:1.0:1787383391.703443:0:15103:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff963502339000): rc 0 00000020:00000080:1.0:1787383391.703445:0:15103:0:(genops.c:906:class_export_put()) final put ffff963502339000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1787383391.703451:0:15103:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff963638add800), last request at 1787383163 00000020:00000080:1.0:1787383391.703455:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e168 00000100:00080000:1.0:1787383391.703465:0:15103:0:(import.c:65:import_set_state_nolock()) ffff963638ad8000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787383391.703474:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963502339000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787383391.703520:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96350233d800 for lustre-MDT0000 00000020:00080000:1.0:1787383391.703536:0:15103:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff963638add800): rc 0 00000020:00000080:1.0:1787383391.703538:0:15103:0:(genops.c:906:class_export_put()) final put ffff963638add800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1787383391.703547:0:15103:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff963640946000), last request at 1787383163 00000020:00000080:1.0:1787383391.703550:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e129 00000100:00080000:1.0:1787383391.703554:0:15103:0:(import.c:65:import_set_state_nolock()) ffff96363cd58000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787383391.703562:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963638add800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787383391.703585:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963638ad8000 for lustre-MDT0000 00000001:00000004:1.0:1787383391.703598:0:15103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1787383391.703677:0:15103:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff963640946000): rc 0 00000004:00000080:1.0:1787383391.703683:0:15103:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb73d87a37ae0 00000100:00080000:1.0:1787383391.703700:0:15103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787383391.703704:0:15103:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1787383391.704479:0:15103:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787383391.704509:0:15103:0:(import.c:65:import_set_state_nolock()) ffff96363d958000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787383391.704547:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984929920:0@lo:39:umount.0 00000100:00100000:1.0:1787383391.704600:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383391.704714:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984929920 00000100:00100000:1.0:1787383391.704721:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984929920 00000100:00100000:1.0:1787383391.704791:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787383391.704800:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874206984929920:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787383391.704824:0:6526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e1c3 00000100:00080000:1.0:1787383391.704836:0:6526:0:(import.c:65:import_set_state_nolock()) ffff96363d95c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787383391.704848:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1787383391.704869:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383391.704880:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984929792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383391.704915:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383391.704955:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984929664 00000100:00100000:0.0:1787383391.704959:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984929664 00000100:00100000:1.0:1787383391.704979:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3646:x1874206984929920:12345-0@lo:39:umount.0 Request processed in 179us (378us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787383391.704991:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984929792 00000100:00100000:0.0:1787383391.704994:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984929792 00000100:00100000:1.0:1787383391.704998:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787383391.705021:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787383391.705031:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984929664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383391.705042:0:7461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1787383391.705048:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363d958000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787383391.705057:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383391.705058:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984929920:0@lo:39:umount.0 00010000:00010000:0.0:1787383391.705066:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b7c00/0xc40acec91532e527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e520 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383391.705074:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+24:3649:x1874206984929792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383391.705085:0:7461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383391.705088:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383391.705101:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c8000/0xc40acec91532e42b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e424 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383391.705115:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383391.705124:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68140aec-1198-480f-b348-a4187c7bb1d1+22:3649:x1874206984929664:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (2321us total) trans 0 rc 0/0 00000100:00080000:1.0:1787383391.705130:0:15103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787383391.705135:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787383391.705136:0:15103:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000100:00100000:3.0:1787383391.705153:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68140aec-1198-480f-b348-a4187c7bb1d1+21:3649:x1874206984929792:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (236us total) trans 0 rc 0/0 00000004:00080000:1.0:1787383391.705153:0:15103:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787383391.705163:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787383391.705178:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984929792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383391.705190:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984929664:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787383391.705221:0:15103:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787383391.705237:0:15103:0:(import.c:65:import_set_state_nolock()) ffff9636313f2800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787383391.705258:0:15103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787383391.705261:0:15103:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1787383391.705271:0:15103:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787383391.705341:0:15103:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787383391.705350:0:15103:0:(import.c:65:import_set_state_nolock()) ffff963503162000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787383391.705353:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984930048:0@lo:9:umount.0 00000020:00080000:1.0:1787383391.705385:0:15103:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9636345acd40) has no exports 00000100:00100000:0.0:1787383391.705391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383391.705569:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984930176:0@lo:9:umount.0 00000100:00100000:0.0:1787383391.705592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383391.706181:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984930048 00000100:00100000:1.0:1787383391.706447:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984930048 00000100:00100000:1.0:1787383391.706503:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984930176 00000100:00100000:1.0:1787383391.706507:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984930176 00000100:00100000:1.0:1787383391.706537:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787383391.706546:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874206984930048:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787383391.706568:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e313 00000100:00080000:1.0:1787383391.706576:0:8436:0:(import.c:65:import_set_state_nolock()) ffff96363db9e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787383391.706609:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1787383391.706719:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3646:x1874206984930048:12345-0@lo:9:umount.0 Request processed in 174us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383391.706726:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787383391.706741:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787383391.706758:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1874206984930176:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787383391.706790:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e455 00000100:00080000:1.0:1787383391.706797:0:8436:0:(import.c:65:import_set_state_nolock()) ffff96363d9cb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787383391.706819:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787383391.706889:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3646:x1874206984930176:12345-0@lo:9:umount.0 Request processed in 131us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383391.706896:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:2.0:1787383391.707066:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.707077:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec91532e424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e42b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787383391.707081:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383391.707086:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787383391.707105:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383391.707110:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.707116:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7400 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383391.707120:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.707128:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383391.707134:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787383391.707137:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963503162000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787383391.707140:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787383391.707144:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787383391.707148:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000004:00080000:0.0:1787383391.707151:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787383391.707155:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787383391.707160:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984930176:0@lo:9:umount.0 00010000:00010000:2.0:1787383391.707177:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787383391.707177:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9636313f2800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787383391.707196:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787383391.707199:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787383391.707202:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984930048:0@lo:9:umount.0 00010000:00010000:2.0:1787383391.707477:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383391.707516:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.707524:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b7400/0xc40acec91532e788 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e78f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.707534:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383391.707538:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b6600/0xc40acec91532dfe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.707551:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b6600 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383391.707554:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b6600/0xc40acec91532dfe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.707561:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b6600/0xc40acec91532dfe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383391.707567:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b6600/0xc40acec91532dfe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383391.707573:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787383391.707575:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787383391.707577:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787383391.707592:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636102b6600/0xc40acec91532dfe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.707597:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383391.707604:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b6600/0xc40acec91532dfe0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.707610:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b6600/0xc40acec91532dfe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532dfe7 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.707620:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383391.707621:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383391.707623:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383391.707671:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984930432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383391.707706:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383391.707737:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383391.707748:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984930304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383391.707812:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383391.707844:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984930432 00000100:00100000:2.0:1787383391.707849:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984930432 00000100:00100000:2.0:1787383391.707879:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984930304 00000100:00100000:2.0:1787383391.707881:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984930304 00000100:00100000:2.0:1787383391.707902:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787383391.707908:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+22:3648:x1874206984930432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383391.707919:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383391.707931:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c8800/0xc40acec91532dfe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532dfe0 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.707942:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383391.707967:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+21:3648:x1874206984930432:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383391.707973:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787383391.707987:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787383391.707992:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+20:3648:x1874206984930304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383391.707998:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383391.708006:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636421f7c00/0xc40acec91532e78f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e788 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383391.708014:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383391.708030:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68140aec-1198-480f-b348-a4187c7bb1d1+19:3648:x1874206984930304:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383391.708036:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787383391.708061:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984930304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383391.708068:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984930432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383391.708090:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787383391.714377:0:15103:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9636345acd40) has no exports 00000020:00000080:1.0:1787383391.813598:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e03b 00000020:00000080:1.0:1787383391.813614:0:15103:0:(genops.c:906:class_export_put()) final put ffff963635068800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787383391.813638:0:15103:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787383391.813868:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963635068800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787383391.815655:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383391.815671:0:15103:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787383391.815676:0:15103:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff963627a3b380) has no exports 00000020:00000080:0.0:1787383391.816050:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e034 00000020:00000080:0.0:1787383391.816071:0:15103:0:(genops.c:906:class_export_put()) final put ffff96363505a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787383391.816129:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383391.816137:0:15103:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787383391.816139:0:15103:0:(genops.c:906:class_export_put()) final put ffff96363505f000/lustre-QMT0000_UUID 00000020:00000080:0.0:1787383391.816142:0:15103:0:(genops.c:865:class_export_destroy()) destroying export ffff96363505f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787383391.816151:0:15103:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1787383391.816408:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96363505a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1787383391.899741:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383392.411703:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984930944:0@lo:400:kworker.0 00000100:00100000:2.0:1787383392.411805:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383392.411979:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984930688:0@lo:400:kworker.0 00000100:00100000:3.0:1787383392.412015:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383392.412066:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984931200:0@lo:400:kworker.0 00000100:00100000:3.0:1787383392.412091:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383392.412114:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787383392.412121:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984930560:0@lo:400:kworker.0 00000100:00100000:3.0:1787383392.412148:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383392.412172:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984931072:0@lo:400:kworker.0 00000100:00100000:3.0:1787383392.412202:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984930560 00000100:00100000:3.0:1787383392.412209:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984930560 00000100:00100000:3.0:1787383392.412253:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1787383392.412262:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+19:3650:x1874206984930560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383392.412341:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68140aec-1198-480f-b348-a4187c7bb1d1+19:3650:x1874206984930560:12345-0@lo:400:kworker.0 Request processed in 80us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383392.412361:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1787383392.412718:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984931456:0@lo:400:kworker.0 00000100:00100000:2.0:1787383392.412745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383392.412794:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787383392.412802:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984930816:0@lo:400:kworker.0 00000100:00100000:0.0:1787383392.413002:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984930944 00000100:00100000:0.0:1787383392.413008:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984930944 00000100:00100000:0.0:1787383392.413035:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984931456 00000100:00100000:0.0:1787383392.413037:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984931456 00000100:00100000:0.0:1787383392.413062:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787383392.413069:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984931456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383392.413153:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984930688 00000100:00100000:1.0:1787383392.413157:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984930688 00000100:00100000:1.0:1787383392.413185:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787383392.413190:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874206984930688:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787383392.413196:0:6526:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787383392.416101:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984931456:12345-0@lo:400:kworker.0 Request processed in 3021us (3344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383392.416116:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1787383392.416155:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787383392.416162:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874206984930944:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787383392.416171:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787383392.416283:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1874206984930944:12345-0@lo:400:kworker.0 Request processed in 46us (4405us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787383392.416291:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:0.0:1787383392.416334:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383392.416518:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984931200 00000100:00100000:0.0:1787383392.416526:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984931200 00000100:00100000:0.0:1787383392.416576:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787383392.416584:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984931200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383392.416628:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984931200:12345-0@lo:400:kworker.0 Request processed in 46us (4537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383392.416635:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:0.0:1787383392.416667:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383392.420061:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383392.421901:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984931072 00000100:00100000:0.0:1787383392.421916:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984931072 00000100:00100000:0.0:1787383392.421985:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1787383392.421995:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984931072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383392.425694:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383392.425762:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984931328:0@lo:400:kworker.0 00000100:00100000:2.0:1787383392.425848:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787383392.425887:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787383392.425892:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96350233a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787383392.425896:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787383392.432523:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984931584:0@lo:400:kworker.0 00000100:00100000:3.0:1787383392.432581:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383392.432633:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984931200:0@lo:400:kworker.0 00000100:00100000:3.0:1787383392.432659:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:3650:1874206984930560:0@lo:400:kworker.0 00000100:00100000:3.0:1787383392.432690:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984931584 00000100:00100000:3.0:1787383392.432696:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984931584 00000100:00100000:3.0:1787383392.432749:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787383392.432758:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984931584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383392.433038:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984931584:12345-0@lo:400:kworker.0 Request processed in 280us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383392.433046:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787383392.433081:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984931584:0@lo:400:kworker.0 00000100:00100000:3.0:1787383392.433119:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984930816 00000100:00100000:3.0:1787383392.433123:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984930816 00000100:00100000:3.0:1787383392.433154:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984931328 00000100:00100000:3.0:1787383392.433157:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984931328 00000100:00100000:3.0:1787383392.433171:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787383392.433176:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1874206984930816:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787383392.433183:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787383392.433213:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1874206984930816:12345-0@lo:400:kworker.0 Request processed in 35us (7527us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787383392.433219:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787383392.433242:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787383392.433247:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1874206984931328:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787383392.433252:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787383392.433277:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3648:x1874206984931328:12345-0@lo:400:kworker.0 Request processed in 28us (7436us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787383392.433282:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1787383392.433317:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787383392.433778:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874206984930688:12345-0@lo:400:kworker.0 Request processed in 20572us (21748us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787383392.433787:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:1.0:1787383392.433972:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787383392.433977:0:3650:0:(import.c:65:import_set_state_nolock()) ffff963635dfb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787383392.433981:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787383392.433987:0:3650:0:(import.c:65:import_set_state_nolock()) ffff963635dfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787383392.433990:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 196 00000100:00080000:1.0:1787383392.433996:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff963635dfb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383392.434024:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362da09500 x1874206984931712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383392.434060:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984930688:0@lo:400:kworker.0 00000100:00100000:1.0:1787383392.434083:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984931712:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787383392.434117:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383392.434149:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984931712 00000100:00100000:1.0:1787383392.434153:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984931712 00000100:00100000:1.0:1787383392.434175:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787383392.434179:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206984931712:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1787383392.434195:0:6525:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1787383392.434252:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383392.434398:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984931072:12345-0@lo:400:kworker.0 Request processed in 12404us (14345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383392.434406:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00010000:00080000:3.0:1787383392.434867:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636409a7b80 x1874206984931072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383392.434880:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984931072:0@lo:400:kworker.0 00000100:00080000:2.0:1787383392.451583:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96350233a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383392.451593:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 214 00000100:00080000:2.0:1787383392.451603:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96350233a800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383392.451720:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963504479f80 x1874206984931840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383392.451759:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984930944:0@lo:400:kworker.0 00010000:00080000:2.0:1787383392.451847:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447b800 x1874206984931456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383392.451884:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984931456:0@lo:400:kworker.0 00000100:00080000:2.0:1787383392.451920:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787383392.451925:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96363d877800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787383392.451929:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787383392.451934:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96363d877800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1787383392.451934:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984931840:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1787383392.451942:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 196 00000100:00080000:2.0:1787383392.451948:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96363d877800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383392.451964:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96350447b800 x1874206984931968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383392.451977:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984930816:0@lo:400:kworker.0 00000100:00080000:2.0:1787383392.451991:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787383392.451995:0:3648:0:(import.c:65:import_set_state_nolock()) ffff963502314800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787383392.451998:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787383392.452002:0:3648:0:(import.c:65:import_set_state_nolock()) ffff963502314800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1787383392.452008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787383392.452010:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 232 00000100:00080000:2.0:1787383392.452016:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff963502314800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383392.452031:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96350447b480 x1874206984932096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383392.452043:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984931328:0@lo:400:kworker.0 00000100:00100000:0.0:1787383392.452068:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984931968:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787383392.452086:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984931840 00000100:00100000:2.0:1787383392.452093:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984931840 00000100:00100000:0.0:1787383392.452096:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383392.452116:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984932096:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787383392.452138:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984931968 00000100:00100000:0.0:1787383392.452142:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383392.452144:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984931968 00000100:00100000:2.0:1787383392.452170:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984932096 00000100:00100000:2.0:1787383392.452174:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984932096 00000100:00100000:2.0:1787383392.452193:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787383392.452200:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1874206984931840:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1787383392.452217:0:6522:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787383392.452262:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1874206984931840:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 60us (257us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787383392.464736:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787383392.464753:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984931968:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1787383392.464789:0:6520:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787383392.467664:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984931968:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 2904us (15559us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787383392.467681:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787383392.467717:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787383392.467723:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984932096:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1787383392.467742:0:6520:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787383392.467801:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984932096:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 77us (15660us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787383392.467809:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1787383392.467892:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363d877800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383392.467898:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787383392.467903:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984931968:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1787383392.467915:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963502314800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383392.467918:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787383392.467921:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984932096:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1787383392.467932:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96350233a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383392.467935:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787383392.467938:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984931840:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787383392.469529:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787383392.479184:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206984931712:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 44995us (45059us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787383392.479198:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:0.0:1787383392.480720:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963635dfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383392.480731:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787383392.480735:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984931712:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787383392.923560:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984932224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383392.923633:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383392.924693:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383392.925281:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984932224 00000100:00100000:0.0:1787383392.925293:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984932224 00000100:00100000:0.0:1787383392.925361:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787383392.925374:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984932224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383392.925407:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383392.925494:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984932224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383392.925502:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787383392.925679:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984932224:0@lo:13:osp-pre-1-1.0 00000001:00100000:2.0:1787383392.926636:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787383392.926649:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1787383392.926653:0:7451:0:(genops.c:906:class_export_put()) final put ffff96363d923000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787383392.926675:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f43e303e-1cf9-4e4a-9e69-93ff23e31c78 00000001:00080000:2.0:1787383392.926681:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1787383392.926683:0:7451:0:(genops.c:906:class_export_put()) final put ffff9635034f6800/f43e303e-1cf9-4e4a-9e69-93ff23e31c78 00000001:00100000:2.0:1787383392.926687:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000001:00080000:2.0:1787383392.926691:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1787383392.926693:0:7451:0:(genops.c:906:class_export_put()) final put ffff96363f9b3800/a75c5b6d-4c9e-4295-9df6-097efce92717 00000001:00100000:3.0:1787383392.930460:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787383392.930470:0:9513:0:(genops.c:906:class_export_put()) final put ffff96363d9ca000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787383392.930493:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000020:00000080:3.0:1787383392.930496:0:9513:0:(genops.c:906:class_export_put()) final put ffff96363f98e000/a75c5b6d-4c9e-4295-9df6-097efce92717 00000020:00000080:1.0:1787383392.931662:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d923000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1787383392.931736:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9635034f6800/f43e303e-1cf9-4e4a-9e69-93ff23e31c78 for lustre-MDT0001 00000020:00000080:1.0:1787383392.931762:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96363f9b3800/a75c5b6d-4c9e-4295-9df6-097efce92717 for lustre-MDT0001 00000020:00000080:1.0:1787383392.931814:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d9ca000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787383392.931838:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96363f98e000/a75c5b6d-4c9e-4295-9df6-097efce92717 for lustre-OST0001 00000020:00000080:1.0:1787383392.931854:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363d95c000 for lustre-MDT0001 00000020:00000080:1.0:1787383392.931859:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9635034f0000 for lustre-MDT0001 00000020:00000080:1.0:1787383392.931865:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363f9b7800 for lustre-MDT0001 00000020:00000080:1.0:1787383392.931869:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363d9cb800 for lustre-OST0001 00000020:00000080:1.0:1787383392.931875:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363f98c000 for lustre-OST0001 00000001:00100000:0.0:1787383392.932328:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787383392.932335:0:8429:0:(genops.c:906:class_export_put()) final put ffff96363db9b000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787383392.932355:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a75c5b6d-4c9e-4295-9df6-097efce92717 00000020:00000080:0.0:1787383392.932357:0:8429:0:(genops.c:906:class_export_put()) final put ffff963503114800/a75c5b6d-4c9e-4295-9df6-097efce92717 00000020:00000080:2.0:1787383392.932558:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363db9b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787383392.932592:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963503114800/a75c5b6d-4c9e-4295-9df6-097efce92717 for lustre-OST0000 00000020:00000080:2.0:1787383392.932610:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363db9e800 for lustre-OST0000 00000020:00000080:2.0:1787383392.932614:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963503110800 for lustre-OST0000 00000040:00080000:3.0:1787383393.627574:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787383393.947029:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984932352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383393.947108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383393.947156:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984932352 00000100:00100000:1.0:1787383393.947164:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984932352 00000100:00100000:1.0:1787383393.947270:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787383393.947286:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984932352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383393.947333:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787383393.947384:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984932352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383393.947392:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00010000:00010000:2.0:1787383393.947534:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383393.947548:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984932352:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787383394.971346:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383395.996329:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383397.019224:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787383397.533729:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787383397.533737:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787383397.533740:0:13975:0:(import.c:65:import_set_state_nolock()) ffff963635dfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383397.533762:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1787383397.533784:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787383397.533791:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff963635dfb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383397.533813:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383397.533818:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963504479500 x1874206984932608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383397.533835:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1787383397.533836:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984932480:0@lo:400:kworker.0 00000100:00080000:2.0:1787383397.533842:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787383397.533846:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96363d877800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383397.533850:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1787383397.533852:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787383397.533855:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96363d877800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383397.533871:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963504478e00 x1874206984932736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383397.533881:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787383397.533895:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787383397.533897:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96350233a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383397.533901:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1787383397.533903:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787383397.533908:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96350233a800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383397.533915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383397.533920:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963504479880 x1874206984932864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383397.533959:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787383397.533963:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787383397.533965:0:13975:0:(import.c:65:import_set_state_nolock()) ffff963502314800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383397.533974:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1787383397.533977:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787383397.533981:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff963502314800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383397.533992:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96350447aa00 x1874206984933248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383397.534003:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984932992:0@lo:400:kworker.0 00000100:00100000:2.0:1787383397.534036:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984933376:0@lo:400:kworker.0 00000100:00100000:1.0:1787383397.534043:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383397.534070:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383397.534077:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383397.534080:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984933120:0@lo:400:kworker.0 00000100:00100000:2.0:1787383397.534106:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383397.534115:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984933504:0@lo:400:kworker.0 00000100:00100000:1.0:1787383397.534116:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383397.534149:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383397.534543:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984932480 00000100:00100000:0.0:1787383397.534553:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984932480 00000100:00100000:0.0:1787383397.534605:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1787383397.534614:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+19:3647:x1874206984932480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383397.534673:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68140aec-1198-480f-b348-a4187c7bb1d1+19:3647:x1874206984932480:12345-0@lo:400:kworker.0 Request processed in 60us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383397.534680:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1787383397.534714:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984933120 00000100:00100000:0.0:1787383397.534717:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984933120 00000100:00100000:0.0:1787383397.534759:0:8914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984933504 00000100:00100000:0.0:1787383397.534763:0:8914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984933504 00000100:00100000:0.0:1787383397.534815:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787383397.534821:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984933120:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787383397.534842:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383397.534848:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383397.534863:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984933120:12345-0@lo:400:kworker.0 Request processed in 41us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383397.534871:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787383397.534886:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984933120:0@lo:400:kworker.0 00000100:00100000:1.0:1787383397.534924:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984932608:0@lo:38:kworker.0 00000100:00100000:1.0:1787383397.534951:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383397.534970:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984932736:0@lo:38:kworker.0 00000100:00100000:0.0:1787383397.535018:0:8914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787383397.535029:0:8914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984933504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383397.535061:0:8914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984933504:12345-0@lo:400:kworker.0 Request processed in 35us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383397.535102:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383397.535119:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984933504:0@lo:400:kworker.0 00000100:00100000:1.0:1787383397.535127:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984932864:0@lo:38:kworker.0 00000100:00100000:2.0:1787383397.535134:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984932480:0@lo:400:kworker.0 00000100:00100000:1.0:1787383397.535152:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383397.535170:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984933248:0@lo:38:kworker.0 00000100:00100000:1.0:1787383397.535189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383397.535191:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984932608 00000100:00100000:2.0:1787383397.535196:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984932608 00000100:00100000:2.0:1787383397.535225:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787383397.535232:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984932608:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787383397.535235:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984932992 00000100:00100000:1.0:1787383397.535240:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984932992 00010000:02000000:2.0:1787383397.535248:0:6526:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1787383397.535255:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383397.535276:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984933376 00000100:00100000:1.0:1787383397.535280:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984933376 00000100:00080000:1.0:1787383397.535291:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383397.535302:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984932736 00000100:00100000:1.0:1787383397.535304:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984932736 00000100:00100000:1.0:1787383397.535312:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984932864 00000100:00100000:1.0:1787383397.535314:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984932864 00000100:00100000:1.0:1787383397.535321:0:10098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984933248 00000100:00100000:1.0:1787383397.535323:0:10098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984933248 00000100:00100000:1.0:1787383397.535332:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1787383397.535338:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984932992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383397.535377:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984932992:12345-0@lo:400:kworker.0 Request processed in 38us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383397.535383:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00010000:00080000:1.0:1787383397.535409:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963504478a80 x1874206984932992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383397.535421:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984932992:0@lo:400:kworker.0 00000100:00100000:1.0:1787383397.535439:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787383397.535446:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984933376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383397.535493:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984933376:12345-0@lo:400:kworker.0 Request processed in 48us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383397.535499:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787383397.535511:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787383397.535515:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1874206984932736:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1787383397.535522:0:10098:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787383397.535555:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1874206984932736:12345-0@lo:38:kworker.0 Request processed in 38us (454us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787383397.535561:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:1.0:1787383397.535651:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363d877800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383397.535657:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787383397.535660:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984932736:0@lo:38:kworker.0 00000100:00100000:1.0:1787383397.535683:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787383397.535687:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984932864:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1787383397.535695:0:6520:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787383397.535723:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984932864:12345-0@lo:38:kworker.0 Request processed in 34us (572us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787383397.535727:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:1.0:1787383397.535746:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96350233a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383397.535749:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787383397.535752:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984932864:0@lo:38:kworker.0 00000100:00100000:1.0:1787383397.535869:0:10098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787383397.535874:0:10098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1874206984933248:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1787383397.535882:0:10098:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787383397.535910:0:10098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1874206984933248:12345-0@lo:38:kworker.0 Request processed in 34us (720us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787383397.535916:0:10098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:1.0:1787383397.535935:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963502314800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383397.535939:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787383397.535941:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984933248:0@lo:38:kworker.0 00010000:00080000:3.0:1787383397.539116:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963504478380 x1874206984933376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383397.539136:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984933376:0@lo:400:kworker.0 00000100:00100000:0.0:1787383397.539984:0:8914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787383397.550902:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984932608:12345-0@lo:38:kworker.0 Request processed in 15662us (15942us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787383397.550916:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:1.0:1787383397.551147:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963635dfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383397.551156:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787383397.551176:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984932608:0@lo:38:kworker.0 00010000:00010000:0.0:1787383398.043682:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383398.043694:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383398.043714:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984933632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383398.043795:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383398.043858:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984933632 00000100:00100000:0.0:1787383398.043877:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984933632 00000100:00100000:0.0:1787383398.043921:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787383398.043930:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984933632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383398.043958:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787383398.043998:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984933632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383398.044007:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787383398.044055:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984933632:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1787383398.053382:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787383398.053401:0:6498:0:(genops.c:906:class_export_put()) final put ffff963640946000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787383398.053539:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963640946000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1787383398.053599:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363cd58000 for lustre-MDT0000 00000100:00100000:2.0:1787383399.067159:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383399.067184:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984933760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383399.067254:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383399.067427:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984933760 00000100:00100000:1.0:1787383399.067447:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984933760 00000100:00100000:1.0:1787383399.067518:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787383399.067527:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984933760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383399.067554:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787383399.067597:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984933760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383399.067604:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1787383399.068002:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383399.068043:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984933760:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787383399.068247:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383400.090953:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383401.117098:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383402.138968:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787383402.650964:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383402.650972:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787383402.650976:0:13975:0:(import.c:65:import_set_state_nolock()) ffff963635dfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383402.650984:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 430 00000100:00080000:0.0:1787383402.650990:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787383402.650998:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff963635dfb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383402.651021:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503d42680 x1874206984934016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383402.651045:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383402.651049:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787383402.651051:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96363d877800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383402.651054:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 430 00000100:00080000:0.0:1787383402.651057:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787383402.651060:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96363d877800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383402.651089:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503d41f80 x1874206984934144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383402.651098:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383402.651101:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787383402.651103:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96350233a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383402.651107:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 430 00000100:00100000:2.0:1787383402.651115:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984934016:0@lo:38:kworker.0 00000100:00080000:0.0:1787383402.651122:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787383402.651129:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96350233a800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383402.651142:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503d42d80 x1874206984934272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383402.651180:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383402.651184:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1787383402.651188:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787383402.651189:0:13975:0:(import.c:65:import_set_state_nolock()) ffff963502314800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383402.651195:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 430 00000100:00080000:0.0:1787383402.651197:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787383402.651201:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff963502314800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383402.651214:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503ff4e00 x1874206984934656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383402.651247:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984934528:0@lo:400:kworker.0 00000100:00100000:0.0:1787383402.651279:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383402.651321:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984934144:0@lo:38:kworker.0 00000100:00100000:2.0:1787383402.651350:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383402.651382:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984933888:0@lo:400:kworker.0 00000100:00100000:2.0:1787383402.651385:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984934272:0@lo:38:kworker.0 00000100:00100000:2.0:1787383402.651429:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383402.651445:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383402.651464:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984934400:0@lo:400:kworker.0 00000100:00100000:2.0:1787383402.651465:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984934656:0@lo:38:kworker.0 00000100:00100000:3.0:1787383402.651478:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984934912:0@lo:400:kworker.0 00000100:00100000:1.0:1787383402.651511:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383402.651518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383402.651533:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984934016 00000100:00100000:2.0:1787383402.651541:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984934016 00000100:00100000:2.0:1787383402.651554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383402.652910:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984934144 00000100:00100000:1.0:1787383402.652921:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984934144 00000100:00100000:1.0:1787383402.653024:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984934272 00000100:00100000:1.0:1787383402.653028:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984934272 00000100:00100000:1.0:1787383402.653041:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984934400 00000100:00100000:1.0:1787383402.653043:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984934400 00000100:00100000:1.0:1787383402.653074:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984934656 00000100:00100000:1.0:1787383402.653077:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984934656 00000100:00100000:1.0:1787383402.653092:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787383402.653101:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984934400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383402.653226:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984934400:12345-0@lo:400:kworker.0 Request processed in 126us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383402.653234:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787383402.653251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787383402.653256:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984934144:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1787383402.653270:0:6520:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787383402.655925:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383402.655946:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984934784:0@lo:400:kworker.0 00000100:00100000:0.0:1787383402.656017:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383402.656069:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984934528 00000100:00100000:0.0:1787383402.656077:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984934528 00000100:00100000:3.0:1787383402.656548:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984933888 00000100:00100000:3.0:1787383402.656554:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984933888 00000100:00100000:3.0:1787383402.656616:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1787383402.656625:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963628fbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+19:3647:x1874206984933888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383402.656679:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963628fbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68140aec-1198-480f-b348-a4187c7bb1d1+19:3647:x1874206984933888:12345-0@lo:400:kworker.0 Request processed in 55us (5235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383402.656686:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1787383402.656715:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984934784 00000100:00100000:3.0:1787383402.656718:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984934784 00000100:00100000:3.0:1787383402.656739:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1787383402.656745:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984934784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383402.656963:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984934784:12345-0@lo:400:kworker.0 Request processed in 54us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383402.656971:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1787383402.657000:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787383402.657005:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1874206984934272:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787383402.657021:0:6521:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787383402.657053:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1874206984934272:12345-0@lo:38:kworker.0 Request processed in 46us (5634us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787383402.657059:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787383402.657072:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787383402.657087:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1874206984934656:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787383402.657099:0:6521:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787383402.657124:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1874206984934656:12345-0@lo:38:kworker.0 Request processed in 36us (5569us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787383402.657129:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00080000:3.0:1787383402.657165:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503ff4700 x1874206984934784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383402.657178:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984934784:0@lo:400:kworker.0 00000100:00100000:3.0:1787383402.657210:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:68140aec-1198-480f-b348-a4187c7bb1d1:3647:1874206984933888:0@lo:400:kworker.0 00000100:00100000:3.0:1787383402.657271:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787383402.657276:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984934016:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787383402.657284:0:6526:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787383402.657311:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984934016:12345-0@lo:38:kworker.0 Request processed in 34us (6126us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787383402.657317:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787383402.657342:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984934912 00000100:00100000:3.0:1787383402.657346:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984934912 00000100:00100000:3.0:1787383402.657370:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787383402.657376:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984934912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383402.657409:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984934912:12345-0@lo:400:kworker.0 Request processed in 33us (5892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383402.657431:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787383402.657458:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984934912:0@lo:400:kworker.0 00000100:00080000:3.0:1787383402.657488:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383402.657492:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383402.657501:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787383402.657562:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503d42300 x1874206984934400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383402.657741:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984934400:0@lo:400:kworker.0 00000100:00080000:2.0:1787383402.658122:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963502314800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383402.658128:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787383402.658132:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984934656:0@lo:38:kworker.0 00000100:00080000:2.0:1787383402.658144:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963635dfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383402.658148:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787383402.658151:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984934016:0@lo:38:kworker.0 00000100:00080000:2.0:1787383402.658174:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96350233a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383402.658178:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787383402.658180:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984934272:0@lo:38:kworker.0 00000100:00100000:0.0:1787383402.658865:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787383402.658878:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984934528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383402.659010:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984934528:12345-0@lo:400:kworker.0 Request processed in 136us (7729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383402.659018:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787383402.659190:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984934528:0@lo:400:kworker.0 00000100:00100000:1.0:1787383402.675653:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984934144:12345-0@lo:38:kworker.0 Request processed in 22385us (24293us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787383402.675669:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:2.0:1787383402.676316:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363d877800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383402.676323:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787383402.676327:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984934144:0@lo:38:kworker.0 00000100:00100000:0.0:1787383403.163047:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787383403.163049:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383403.163070:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984935040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383403.163136:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383403.163346:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984935040 00000100:00100000:3.0:1787383403.163355:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984935040 00000100:00100000:3.0:1787383403.163406:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787383403.163424:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984935040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383403.163453:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787383403.163498:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984935040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383403.163506:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787383403.163636:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984935040:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1787383403.867723:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787383404.187320:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383404.187659:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383404.187682:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984935168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383404.187762:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383404.188072:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984935168 00000100:00100000:1.0:1787383404.188080:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984935168 00000100:00100000:1.0:1787383404.188159:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787383404.188170:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984935168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383404.188200:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:3.0:1787383404.188307:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383404.188658:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984935168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 490us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383404.188667:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787383404.193311:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984935168:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787383405.211882:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:0.0:1787383406.236680:0:15103:0:(genops.c:1873:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? 00000020:01000000:0.0:1787383406.254428:0:15103:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9635035ccf00 - data ffff963629351438/ffff96362d911400 00000020:01000000:0.0:1787383406.254564:0:15103:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96363512d420 - data ffff96362910da20/ffff96363c64dc00 00010000:00010000:3.0:1787383406.255109:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787383406.265112:0:15103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1787383406.336280:0:15103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787383406.336289:0:15103:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787383406.336306:0:15103:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff963608cfaa00 x1874206984929920/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787383401 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383406.336343:0:15103:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787383406.337991:0:15103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787383406.337997:0:15103:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:3.0:1787383406.338339:0:15103:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787383406.338342:0:15103:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787383406.339292:0:8912:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787383406.339298:0:8912:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787383406.339308:0:8912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787383406.340043:0:15103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787383406.340048:0:15103:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1787383406.340063:0:15103:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787383406.340065:0:15103:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787383406.340614:0:9961:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787383406.340618:0:9961:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787383406.340628:0:9961:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787383406.341842:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e003 00000020:00000080:3.0:1787383406.341853:0:15103:0:(genops.c:906:class_export_put()) final put ffff963640921000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787383406.342827:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963640921000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787383406.349059:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e018 00000020:00000080:1.0:1787383406.349075:0:15103:0:(genops.c:906:class_export_put()) final put ffff9636313f6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787383406.349089:0:15103:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787383406.349094:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383406.349102:0:15103:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787383406.349106:0:15103:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9636345a99c0) has no exports 00000004:01000000:1.0:1787383406.349264:0:15103:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787383406.349273:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e44e 00000020:00000080:1.0:1787383406.349277:0:15103:0:(genops.c:906:class_export_put()) final put ffff9635036f1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787383406.349280:0:15103:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787383406.349284:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383406.349293:0:15103:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787383406.349296:0:15103:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff963503703380) has no exports 00000020:00000080:1.0:1787383406.349302:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e447 00000020:00000080:1.0:1787383406.349305:0:15103:0:(genops.c:906:class_export_put()) final put ffff963503166000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787383406.349628:0:15103:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787383406.349633:0:15103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787383406.349637:0:15103:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1787383406.349643:0:15103:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787383406.349656:0:15103:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787383406.349688:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787383406.349696:0:15103:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787383406.349701:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e30c 00000020:00000080:1.0:1787383406.349706:0:15103:0:(genops.c:906:class_export_put()) final put ffff963502339800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787383406.349710:0:15103:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787383406.349713:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383406.349717:0:15103:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787383406.349719:0:15103:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9636351b3380) has no exports 00000020:00000080:1.0:1787383406.349723:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e305 00000020:00000080:1.0:1787383406.349726:0:15103:0:(genops.c:906:class_export_put()) final put ffff96363d9c8800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787383406.350076:0:15103:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787383406.350080:0:15103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787383406.350082:0:15103:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:1.0:1787383406.350086:0:15103:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787383406.350087:0:15103:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787383406.350115:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787383406.350122:0:15103:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787383406.350132:0:15103:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787383406.350137:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e1bc 00000020:00000080:1.0:1787383406.350141:0:15103:0:(genops.c:906:class_export_put()) final put ffff96363cd26000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787383406.350145:0:15103:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787383406.350149:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383406.350153:0:15103:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787383406.350155:0:15103:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9636313b99c0) has no exports 00000020:00000080:1.0:1787383406.350159:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e1b5 00000020:00000080:1.0:1787383406.350162:0:15103:0:(genops.c:906:class_export_put()) final put ffff96363d95d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787383406.350950:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff9636313f6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787383406.350965:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff9635036f1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787383406.350969:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963503166000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787383406.350985:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963503162000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787383406.350991:0:13975:0:(genops.c:906:class_export_put()) final put ffff9635034f3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787383406.350994:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff9635034f3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787383406.350999:0:13975:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787383406.351080:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963502339800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787383406.351086:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d9c8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787383406.351090:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9636313f2800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787383406.351094:0:13975:0:(genops.c:906:class_export_put()) final put ffff96363d9ce000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787383406.351097:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d9ce000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787383406.351100:0:13975:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787383406.351126:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363cd26000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787383406.351132:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d95d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787383406.351163:0:15103:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787383406.351166:0:15103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787383406.351170:0:15103:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787383406.351174:0:15103:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787383406.351255:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383406.351263:0:15103:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787383406.351288:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383406.351291:0:15103:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787383406.351294:0:15103:0:(genops.c:906:class_export_put()) final put ffff963640922800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787383406.351297:0:15103:0:(genops.c:865:class_export_destroy()) destroying export ffff963640922800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787383406.351301:0:15103:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787383406.351356:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e01f 00000020:00000080:0.0:1787383406.351361:0:15103:0:(genops.c:906:class_export_put()) final put ffff9636313f7800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787383406.351366:0:15103:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787383406.351370:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383406.351374:0:15103:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787383406.351383:0:15103:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9636345ab380) has no exports 00000020:00000080:0.0:1787383406.351413:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383406.351417:0:15103:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787383406.351420:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e026 00000020:00000080:0.0:1787383406.351424:0:15103:0:(genops.c:906:class_export_put()) final put ffff9636313f4000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787383406.351433:0:15103:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9636064d1800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787383406.351436:0:15103:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9636064d1800 3 00000020:01000004:0.0:1787383406.351439:0:15103:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9636064d1800 from lustre-MDT0000 00000020:00000080:0.0:1787383406.351457:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383406.351460:0:15103:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787383406.351463:0:15103:0:(genops.c:906:class_export_put()) final put ffff963640924800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787383406.351465:0:15103:0:(genops.c:865:class_export_destroy()) destroying export ffff963640924800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787383406.351471:0:15103:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787383406.351500:0:15103:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787383406.351503:0:15103:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787383406.351506:0:15103:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787383406.351508:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383406.351511:0:15103:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787383406.351517:0:15103:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff963620411000 68140aec-1198-480f-b348-a4187c7bb1d1 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787383406.351522:0:15103:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9636313b8000) has exports, disconnecting them 00000020:00080000:0.0:1787383406.351526:0:15103:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff963620411000), last request at 1787383143 00000020:00000080:0.0:1787383406.351540:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532dfbd 00000020:00010000:0.0:1787383406.351544:0:15103:0:(genops.c:1942:obd_stale_export_put()) Put export ffff963620411000: total 2 00000100:00080000:0.0:1787383406.351548:0:15103:0:(import.c:65:import_set_state_nolock()) ffff963620416000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787383406.351559:0:15103:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff963620411000): rc 0 00000020:00080000:0.0:1787383406.351563:0:15103:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9636313b8000) has no exports 00000020:00010000:3.0:1787383406.351649:0:6507:0:(genops.c:1928:obd_stale_export_get()) Get export ffff963620411000: total 2 00010000:00010000:3.0:1787383406.351685:0:6507:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff963620411000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787383406.351715:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac9c00/0xc40acec91532e4e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e4da expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383406.351730:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b6c00/0xc40acec91532e4ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e4e8 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383406.351740:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac9000/0xc40acec91532e50b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e504 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383406.351749:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636421f7600/0xc40acec91532e0c0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e0b9 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383406.351762:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac9a00/0xc40acec91532e4fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e4f6 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383406.351799:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac8000/0xc40acec91532e765 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e75e expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383406.351809:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b7600/0xc40acec91532e773 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e76c expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383406.351820:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9c00/0xc40acec91532e0ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e0c7 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383406.351848:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636013fdc00/0xc40acec91532e535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e52e expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383406.351859:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c1800/0xc40acec91532e4c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e4be expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383406.351869:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b6000/0xc40acec91532e4d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e4cc expref: 4 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383406.351880:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636102b7e00/0xc40acec91532e781 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e77a expref: 3 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383406.351891:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c1600/0xc40acec91532e3e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532e3de expref: 2 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383406.351901:0:6507:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff963620411000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1787383406.351915:0:6507:0:(genops.c:906:class_export_put()) final put ffff963620411000/68140aec-1198-480f-b348-a4187c7bb1d1 00010000:00010000:3.0:1787383406.351920:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383406.351922:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383406.351924:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383406.351953:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff96362273cc00:6512] 0 exiting: rc = 1 00000100:00100000:3.0:1787383406.352030:0:6515:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff963610edba00:6515] 2 exiting: rc = 0 00000100:00100000:3.0:1787383406.352093:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff963638b46200:6514] 1 exiting: rc = 0 00000020:00000080:3.0:1787383406.352130:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363d958000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787383406.352135:0:13975:0:(genops.c:906:class_export_put()) final put ffff963640940000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787383406.352137:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963640940000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787383406.352141:0:13975:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787383406.352180:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff9636313f7800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787383406.352190:0:13975:0:(genops.c:906:class_export_put()) final put ffff963640920000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787383406.352192:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963640920000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787383406.352195:0:13975:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787383406.352224:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff9636313f4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787383406.352228:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963620411000/68140aec-1198-480f-b348-a4187c7bb1d1 for MGS 00000020:00000080:3.0:1787383406.352249:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963620416000 for MGS 00000100:00100000:0.0:1787383406.352336:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352346:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352352:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352358:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352364:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352369:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352382:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352387:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352404:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352411:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352416:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352422:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352428:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352435:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352442:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352448:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352454:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352460:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352466:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352472:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352478:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352485:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352491:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352496:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352502:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352509:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352514:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352520:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352526:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352532:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352538:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352544:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352549:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352555:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352560:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352566:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352570:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352576:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352581:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352587:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352592:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352605:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352610:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352616:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352622:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352627:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352633:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352638:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352643:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352649:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352654:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352660:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352666:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352671:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352677:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352683:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352688:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352694:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352700:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352706:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352711:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352716:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352721:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383406.352727:0:15103:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787383406.354113:0:15103:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9635035cc7e0 - data ffff963629351bd0/ffff963503394400 00000020:01000000:0.0:1787383406.354233:0:15103:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff963603878960 - data ffff9636290a4bd0/ffff963620426000 00000020:00000080:0.0:1787383406.355017:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532dfa8 00000020:00000080:0.0:1787383406.355027:0:15103:0:(genops.c:906:class_export_put()) final put ffff963622d82000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787383406.355047:0:15103:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9636064d1800 from MGS, refs=2 00000020:01000004:0.0:1787383406.355051:0:15103:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9636064d1800 2 00000020:01000004:0.0:1787383406.355054:0:15103:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9636064d1800 from MGS 00000020:00000080:0.0:1787383406.355074:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383406.355080:0:15103:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787383406.355083:0:15103:0:(genops.c:906:class_export_put()) final put ffff963622d80800/MGS 00000020:00000080:0.0:1787383406.355086:0:15103:0:(genops.c:865:class_export_destroy()) destroying export ffff963622d80800/MGS for MGS 00000020:01000000:0.0:1787383406.355092:0:15103:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787383406.355159:0:15103:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787383406.355163:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383406.355168:0:15103:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787383406.355175:0:15103:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff963640921800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787383406.355180:0:15103:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9636351b19c0) has exports, disconnecting them 00000020:00080000:0.0:1787383406.355185:0:15103:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff963640921800), last request at 1787383143 00000020:00000080:0.0:1787383406.355190:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e073 00000020:00080000:0.0:1787383406.355200:0:15103:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff963640921800): rc 0 00000020:00000080:0.0:1787383406.355204:0:15103:0:(genops.c:906:class_export_put()) final put ffff963640921800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787383406.355964:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963622d82000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787383406.355980:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963640921800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787383406.362835:0:15103:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787383406.362846:0:15103:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787383406.362850:0:15103:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787383406.362859:0:15103:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787383406.362896:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963640923800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787383406.363033:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383406.363044:0:15103:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787383406.363049:0:15103:0:(genops.c:906:class_export_put()) final put ffff96363506e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787383406.363053:0:15103:0:(genops.c:865:class_export_destroy()) destroying export ffff96363506e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787383406.363059:0:15103:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787383406.363140:0:15103:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9636064d1800 1 00000020:00000080:3.0:1787383406.363146:0:15103:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532df9a 00000020:00000080:3.0:1787383406.363152:0:15103:0:(genops.c:906:class_export_put()) final put ffff963622d85000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787383406.363162:0:15103:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787383406.363171:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963622d85000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787383406.363182:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383406.363187:0:15103:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787383406.363191:0:15103:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff963627a3cd40) has no exports 00000020:00000080:2.0:1787383406.454762:0:15103:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383406.454803:0:15103:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787383406.454809:0:15103:0:(genops.c:906:class_export_put()) final put ffff9636064d2800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787383406.454813:0:15103:0:(genops.c:865:class_export_destroy()) destroying export ffff9636064d2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787383406.454823:0:15103:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787383406.454930:0:15103:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9636064d7800 00000020:02000400:2.0:1787383406.454987:0:15103:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787383407.259183:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787383407.774967:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383407.774977:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787383407.774984:0:8:0:(import.c:65:import_set_state_nolock()) ffff963635dfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383407.774998:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 435 00000100:00080000:0.0:1787383407.775006:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787383407.775016:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff963635dfb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383407.775053:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503fd8a80 x1874206984935424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383407.775082:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383407.775089:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787383407.775091:0:8:0:(import.c:65:import_set_state_nolock()) ffff96363d877800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383407.775096:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 435 00000100:00080000:0.0:1787383407.775101:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787383407.775107:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96363d877800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383407.775127:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503fdb800 x1874206984935552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383407.775139:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383407.775161:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787383407.775164:0:8:0:(import.c:65:import_set_state_nolock()) ffff96350233a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383407.775169:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 435 00000100:00080000:0.0:1787383407.775173:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787383407.775180:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96350233a800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383407.775201:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503fd9c00 x1874206984935680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383407.775254:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383407.775259:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787383407.775262:0:8:0:(import.c:65:import_set_state_nolock()) ffff963502314800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383407.775266:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 435 00000100:00080000:0.0:1787383407.775270:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787383407.775276:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff963502314800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383407.775296:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503fd9500 x1874206984936064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383407.775364:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984936192:0@lo:400:kworker.0 00000100:00100000:0.0:1787383407.775503:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383407.775590:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787383407.775598:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984935296:0@lo:400:kworker.0 00000400:00000100:0.0:1787383407.775622:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874206984935296 offset 0 length 224: 4 00000100:00100000:0.0:1787383407.775641:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984936320:0@lo:400:kworker.0 00000100:00100000:0.0:1787383407.775669:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383407.775699:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984935808:0@lo:400:kworker.0 00000100:00100000:0.0:1787383407.775730:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383407.775840:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383407.775852:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984935936:0@lo:400:kworker.0 00000100:00100000:0.0:1787383407.775894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383407.775933:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984936192 00000100:00100000:0.0:1787383407.775941:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984936192 00000100:00100000:0.0:1787383407.776009:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984935808 00000100:00100000:0.0:1787383407.776014:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984935808 00000100:00100000:0.0:1787383407.776060:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787383407.776076:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984936192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383407.776166:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984936192:12345-0@lo:400:kworker.0 Request processed in 93us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383407.776178:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787383407.776207:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787383407.776218:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984935808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383407.776270:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984935808:12345-0@lo:400:kworker.0 Request processed in 53us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383407.776279:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787383407.776308:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984936320 00000100:00100000:0.0:1787383407.776314:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984936320 00000100:00100000:0.0:1787383407.776357:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984935936 00000100:00100000:0.0:1787383407.776363:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984935936 00000100:00100000:0.0:1787383407.776415:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787383407.776427:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984936320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383407.776464:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984936320:12345-0@lo:400:kworker.0 Request processed in 42us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383407.776470:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787383407.776481:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787383407.776486:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984935936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383407.776534:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984935936:12345-0@lo:400:kworker.0 Request processed in 46us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383407.776544:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1787383407.776579:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383407.776584:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383407.776587:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383407.776636:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984936320:0@lo:400:kworker.0 00010000:00080000:0.0:1787383407.776653:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff963503fd8380 x1874206984936192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383407.776663:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984936192:0@lo:400:kworker.0 00000100:00100000:0.0:1787383407.776704:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984935936:0@lo:400:kworker.0 00010000:00080000:0.0:1787383407.776714:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff963503fdb480 x1874206984935808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383407.776724:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984935808:0@lo:400:kworker.0 00000100:00100000:2.0:1787383407.778930:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984935424:0@lo:38:kworker.0 00000100:00100000:2.0:1787383407.779415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383407.779472:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984935552:0@lo:38:kworker.0 00000100:00100000:2.0:1787383407.779505:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383407.779529:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984935680:0@lo:38:kworker.0 00000100:00100000:2.0:1787383407.779553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383407.779574:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984936064:0@lo:38:kworker.0 00000100:00100000:2.0:1787383407.779597:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383407.779651:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984935552 00000100:00100000:2.0:1787383407.779660:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984935552 00000100:00100000:2.0:1787383407.779699:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984935680 00000100:00100000:2.0:1787383407.779703:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984935680 00000100:00100000:2.0:1787383407.779720:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984936064 00000100:00100000:2.0:1787383407.779722:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984936064 00000100:00100000:2.0:1787383407.779736:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787383407.779744:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984935552:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787383407.779804:0:6520:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787383407.779853:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984935552:12345-0@lo:38:kworker.0 Request processed in 108us (347us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787383407.779861:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787383407.779898:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787383407.779902:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984935680:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787383407.779913:0:6520:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787383407.779939:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984935680:12345-0@lo:38:kworker.0 Request processed in 36us (386us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787383407.779946:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787383407.779957:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787383407.779961:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984936064:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787383407.779970:0:6520:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787383407.779993:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984936064:12345-0@lo:38:kworker.0 Request processed in 30us (395us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787383407.779999:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787383407.780140:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984935424 00000100:00100000:1.0:1787383407.780146:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984935424 00000100:00100000:1.0:1787383407.780174:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787383407.780179:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984935424:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787383407.780191:0:6526:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787383407.780227:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984935424:12345-0@lo:38:kworker.0 Request processed in 46us (813us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787383407.780233:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:2.0:1787383407.782195:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963635dfb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383407.782211:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787383407.782218:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984935424:0@lo:38:kworker.0 00000100:00080000:2.0:1787383407.782314:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363d877800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383407.782319:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787383407.782323:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984935552:0@lo:38:kworker.0 00000100:00080000:2.0:1787383407.782338:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96350233a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383407.782342:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787383407.782345:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984935680:0@lo:38:kworker.0 00000100:00080000:2.0:1787383407.782357:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963502314800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383407.782361:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787383407.782365:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984936064:0@lo:38:kworker.0 00010000:00010000:2.0:1787383408.283841:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383408.284361:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984936448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383408.284464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383408.284559:0:13816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984936448 00000100:00100000:1.0:1787383408.284569:0:13816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984936448 00000100:00100000:1.0:1787383408.284626:0:13816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787383408.284638:0:13816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984936448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787383408.284689:0:13816:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787383408.284740:0:13816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984936448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383408.284747:0:13816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787383408.284843:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984936448:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787383409.306916:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383409.306956:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984936576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383409.307058:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383409.307118:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984936576 00000100:00100000:0.0:1787383409.307128:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984936576 00000100:00100000:0.0:1787383409.307201:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787383409.307213:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984936576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787383409.307251:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787383409.307303:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984936576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383409.307311:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1787383409.307333:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383409.307385:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984936576:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787383410.331379:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787383410.480468:0:15306:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787383410.500179:0:15306:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787383410.500254:0:15306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.500293:0:15306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.501935:0:15306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.501952:0:15306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.502025:0:15306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787383410.502034:0:15306:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787383410.502086:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787383410.502092:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787383410.502100:0:15306:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787383410.502108:0:15306:0:(import.c:65:import_set_state_nolock()) ffff96363d877800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787383410.502114:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787383410.502116:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787383410.502120:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787383410.505082:0:15306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.505107:0:15306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.505116:0:15306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.505124:0:15306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383410.506953:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383410.506972:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383410.506986:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0400 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383410.506990:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383410.507008:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383410.507020:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383410.507026:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787383410.507029:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787383410.507033:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787383410.507181:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383410.507201:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787383410.507265:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984936704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383410.507343:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383410.507492:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383410.507498:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383410.507510:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532e4f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e4fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.507573:0:15306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787383410.507592:0:15306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.507603:0:15306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.507611:0:15306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.507621:0:15306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383410.507628:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383410.507637:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383410.507638:0:15306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787383410.507645:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.507650:0:15306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.507662:0:15306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.507669:0:15306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.507701:0:15306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383410.507707:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0000 already unused, calling callback (ffffffffc129ec20) 00010000:00010000:3.0:1787383410.507717:0:15306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:1.0:1787383410.507717:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.507732:0:15306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655200/0xc40acec91532e0c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383410.507737:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383410.507744:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383410.507762:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787383410.507798:0:15306:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655200/0xc40acec91532e0c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383410.507799:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787383410.507809:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787383410.507818:0:15306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963601655200/0xc40acec91532e0c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.507827:0:15306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff963601655200/0xc40acec91532e0c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383410.507839:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383410.507840:0:15306:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787383410.507847:0:15306:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1787383410.507857:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383410.507995:0:15307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383410.508005:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383410.508014:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fda00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383410.508017:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383410.508027:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383410.508035:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383410.508048:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787383410.508051:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1787383410.508053:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1787383410.508082:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383410.508090:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383410.508141:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383410.508150:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532e3de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e3e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787383410.508158:0:15306:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1787383410.508166:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00010000:00010000:1.0:1787383410.508170:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:3.0:1787383410.508173:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1787383410.508178:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963601655200/0xc40acec91532e0c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787383410.508183:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00010000:00010000:1.0:1787383410.508187:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963601655200 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383410.508193:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963601655200/0xc40acec91532e0c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787383410.508195:0:15306:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff963503165800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383410.508205:0:15306:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff96363506f800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383410.508226:0:15306:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff963627ae4d40) has exports, disconnecting them 00010000:00010000:1.0:1787383410.508231:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601655200/0xc40acec91532e0c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787383410.508234:0:15306:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff963503165800), last request at 1787383407 00000020:00000080:3.0:1787383410.508251:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e3a6 10000000:00010000:1.0:1787383410.508253:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601655200/0xc40acec91532e0c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383410.508262:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787383410.508265:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787383410.508268:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:3.0:1787383410.508276:0:15306:0:(import.c:65:import_set_state_nolock()) ffff963503160800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787383410.508296:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963601655200/0xc40acec91532e0c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383410.508305:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:3.0:1787383410.508380:0:15306:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff963503165800): rc 0 00000020:00000080:3.0:1787383410.508385:0:15306:0:(genops.c:906:class_export_put()) final put ffff963503165800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1787383410.508402:0:15306:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff96363506f800), last request at 1787383407 00000020:00000080:3.0:1787383410.508406:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e280 00000100:00080000:3.0:1787383410.508413:0:15306:0:(import.c:65:import_set_state_nolock()) ffff96363506e000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787383410.508429:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963503165800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00010000:00010000:0.0:1787383410.508677:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383410.508687:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec91532e504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e50b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383410.508706:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383410.508708:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383410.508710:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383410.508726:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383410.508746:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984936832:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1787383410.508760:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963503160800 for lustre-MDT0001 00000020:00080000:3.0:1787383410.508823:0:15306:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96363506f800): rc 0 00000020:00000080:3.0:1787383410.508827:0:15306:0:(genops.c:906:class_export_put()) final put ffff96363506f800/lustre-MDT0001-lwp-OST0000_UUID 00000100:00100000:2.0:1787383410.508836:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:3.0:1787383410.508846:0:15306:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb73d8165fae0 00000100:00100000:2.0:1787383410.508901:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984936704 00000100:00100000:2.0:1787383410.508910:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984936704 00000100:00100000:2.0:1787383410.508940:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984936832 00000100:00100000:2.0:1787383410.508943:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984936832 00000100:00100000:2.0:1787383410.508960:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787383410.508967:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1874206984936704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787383410.508974:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787383410 with bad export cookie 14126330544240385981 00000100:00080000:3.0:1787383410.509185:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:0.0:1787383410.509189:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96363506f800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:3.0:1787383410.509191:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000020:00000080:0.0:1787383410.509229:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363506e000 for lustre-MDT0001 00010000:00010000:1.0:1787383410.509536:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963601655200/0xc40acec91532e0c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383410.509552:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601655200/0xc40acec91532e0c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e0ce expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383410.509583:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984937088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383410.509622:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383410.509663:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383410.509680:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984936960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383410.509703:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383410.509824:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383410.509827:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383410.509829:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787383410.510265:0:15306:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787383410.510275:0:15306:0:(import.c:65:import_set_state_nolock()) ffff963635dfb000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:3.0:1787383410.510650:0:7461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984937088 00000100:00100000:0.0:1787383410.510651:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984936960 00000100:00100000:3.0:1787383410.510664:0:7461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984937088 00000100:00100000:0.0:1787383410.510665:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984936960 00000100:00100000:0.0:1787383410.510713:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787383410.510721:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96361803c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3649:x1874206984936832:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383410.510728:0:7461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00020000:0.0:1787383410.510736:0:8450:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787383410 with bad export cookie 14126330544240385981 00000100:00100000:3.0:1787383410.510743:0:7461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1874206984936960:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787383410.510752:0:7461:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787383410 with bad export cookie 14126330544240385981 00000100:00100000:0.0:1787383410.510835:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96361803c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3649:x1874206984936832:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (2002us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787383410.510843:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787383410.510863:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787383410.510868:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3648:x1874206984937088:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787383410.510884:0:8450:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787383410 with bad export cookie 14126330544240385981 00000100:00100000:0.0:1787383410.510917:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3648:x1874206984937088:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (1295us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787383410.510923:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383410.511555:0:7461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1874206984936960:12345-0@lo:103:ldlm_bl.0 Request processed in 808us (1845us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787383410.511567:0:7461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787383410.512055:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787383410.512061:0:3649:0:(import.c:65:import_set_state_nolock()) ffff963620414800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787383410.512065:0:3649:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787383410.513131:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787383410.513737:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787383410.513743:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1787383410.513762:0:15306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787383410.513834:0:15306:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787383410.513861:0:15306:0:(import.c:65:import_set_state_nolock()) ffff96363db9d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787383410.513878:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787383410.513880:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1787383410.513889:0:15306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787383410.513944:0:15306:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787383410.513952:0:15306:0:(import.c:65:import_set_state_nolock()) ffff9635036f5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787383410.513975:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff963627ae4d40) has no exports 00010000:00010000:0.0:1787383410.515522:0:15308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383410.515528:0:15308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383410.515530:0:15308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383410.515540:0:15307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383410.515559:0:15307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7200 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383410.515564:0:15307:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383410.515575:0:15307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383410.515583:0:15307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383410.515601:0:15307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787383410.515604:0:15307:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787383410.515607:0:15307:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1787383410.522145:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984937216:0@lo:9:umount.0 00000100:00100000:2.0:1787383410.522250:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383410.522301:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984937344:0@lo:9:umount.0 00000100:00100000:2.0:1787383410.522344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383410.523551:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984937216 00000100:00100000:2.0:1787383410.523567:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984937216 00000100:00100000:2.0:1787383410.523632:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984937344 00000100:00100000:2.0:1787383410.523637:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984937344 00000100:00100000:2.0:1787383410.523674:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787383410.523684:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874206984937216:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787383410.523741:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e2cd 00000100:00080000:2.0:1787383410.523753:0:8436:0:(import.c:65:import_set_state_nolock()) ffff96363d9cd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787383410.523831:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:2.0:1787383410.524040:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3646:x1874206984937216:12345-0@lo:9:umount.0 Request processed in 355us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383410.524050:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787383410.524069:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787383410.524076:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1874206984937344:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787383410.524090:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e40f 00000100:00080000:2.0:1787383410.524096:0:8436:0:(import.c:65:import_set_state_nolock()) ffff96363d9ce800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787383410.524125:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787383410.524211:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3646:x1874206984937344:12345-0@lo:9:umount.0 Request processed in 134us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383410.524218:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1787383410.524248:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787383410.524264:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787383410.524303:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363db9d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787383410.524318:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787383410.524320:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787383410.524325:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984937216:0@lo:9:umount.0 00000100:00080000:2.0:1787383410.524338:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9635036f5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787383410.526220:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787383410.526233:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787383410.526245:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984937344:0@lo:9:umount.0 00000100:00100000:2.0:1787383410.526704:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1874206984936704:12345-0@lo:103:ldlm_bl.0 Request processed in 17726us (19351us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787383410.526733:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787383410.540276:0:3649:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.102@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787383410.540284:0:3649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787383410.540442:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503fdaa00 x1874206984935296/t0(0) o400->MGC192.168.203.102@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787383423 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383410.540466:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96362da0bb80 x1874206984936704/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787383426 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383410.540477:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96362da08380 x1874206984936832/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787383426 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383410.540522:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96362da09500 x1874206984937088/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787383426 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383410.540533:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503f22a00 x1874206984936960/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787383426 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787383410.540984:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787383410.540989:0:3649:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787383410.540990:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787383410.541155:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff963620414800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1787383410.541207:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984937088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383410.541238:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:68140aec-1198-480f-b348-a4187c7bb1d1:3648:1874206984936960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383410.541528:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787383410.543980:0:3649:0:(import.c:65:import_set_state_nolock()) ffff963620414800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383410.543999:0:3649:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 176 00000100:00080000:3.0:1787383410.544014:0:3649:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import ffff963620414800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383410.544093:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f6a680 x1874206984937472/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1787383410.544137:0:15307:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383410.544155:0:15307:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787383410.544182:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68140aec-1198-480f-b348-a4187c7bb1d1:3646:1874206984937472:0@lo:250:ptlrpcd_00_02.0 00010000:00010000:0.0:1787383410.544190:0:15307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383410.544200:0:15307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b7200/0xc40acec91532e77a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532e781 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383410.544218:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383410.544221:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383410.544225:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1787383410.544253:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874206984937472 offset 0 length 520: 4 00000100:00100000:0.0:1787383410.544834:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383410.544856:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:68140aec-1198-480f-b348-a4187c7bb1d1:0:1874206984937600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383410.545069:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984936704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383410.545086:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984935296:0@lo:400:kworker.0 00000100:00100000:3.0:1787383410.545119:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:68140aec-1198-480f-b348-a4187c7bb1d1:3649:1874206984936832:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787383410.548332:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff963627ae4d40) has no exports 00000020:01000000:1.0:1787383410.618217:0:15306:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9635035cc240 - data ffff96362933bd80/ffff96362d911c00 00000020:01000000:1.0:1787383410.618391:0:15306:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96363d860cc0 - data ffff963629204360/ffff96363d967000 00000001:00000004:1.0:1787383410.633340:0:15306:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1787383410.698160:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787383410.698170:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1787383410.698179:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787383410.701447:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787383410.701459:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1787383410.701483:0:15306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787383410.701486:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787383410.701900:0:8908:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787383410.701907:0:8908:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1787383410.701919:0:8908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787383410.702612:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787383410.702618:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1787383410.702673:0:15306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787383410.702693:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787383410.708321:0:9956:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787383410.708331:0:9956:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1787383410.708349:0:9956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787383410.710649:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e0ea 00000020:00000080:0.0:1787383410.710663:0:15306:0:(genops.c:906:class_export_put()) final put ffff96363cd27000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787383410.711080:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363cd27000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787383410.712468:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e0ff 00000020:00000080:0.0:1787383410.712480:0:15306:0:(genops.c:906:class_export_put()) final put ffff96363cd5e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787383410.712561:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1787383410.712568:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383410.712576:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787383410.712580:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff963627ae19c0) has no exports 00000004:01000000:0.0:1787383410.712738:0:15306:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787383410.712746:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e408 00000020:00000080:0.0:1787383410.712751:0:15306:0:(genops.c:906:class_export_put()) final put ffff9635034f4000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787383410.712755:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787383410.712758:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383410.713018:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787383410.713022:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9635033c0000) has no exports 00000020:00000080:0.0:1787383410.713029:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e401 00000020:00000080:0.0:1787383410.713034:0:15306:0:(genops.c:906:class_export_put()) final put ffff9635036f0800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1787383410.713472:0:15306:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787383410.713477:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787383410.713482:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1787383410.713487:0:15306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787383410.713490:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787383410.713518:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383410.713526:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787383410.713533:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e2c6 00000020:00000080:0.0:1787383410.713537:0:15306:0:(genops.c:906:class_export_put()) final put ffff96363db9b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787383410.713541:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787383410.713545:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383410.713548:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787383410.713551:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9636352c99c0) has no exports 00000020:00000080:0.0:1787383410.713555:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e2bf 00000020:00000080:0.0:1787383410.713558:0:15306:0:(genops.c:906:class_export_put()) final put ffff96363db98800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1787383410.713905:0:15306:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787383410.713909:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787383410.713911:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:0.0:1787383410.713915:0:15306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787383410.713917:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787383410.713939:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383410.713945:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787383410.714052:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363cd5e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1787383410.714062:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff9635034f4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787383410.714067:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff9635036f0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787383410.714072:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9635036f5000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787383410.714077:0:13975:0:(genops.c:906:class_export_put()) final put ffff963503162800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787383410.714079:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963503162800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787383410.714090:0:13975:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787383410.714164:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363db9b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787383410.714170:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363db98800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787383410.714174:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363db9d000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787383410.714178:0:13975:0:(genops.c:906:class_export_put()) final put ffff963636f5f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787383410.714180:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963636f5f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787383410.714183:0:13975:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1787383410.714241:0:15306:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787383410.714247:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e122 00000020:00000080:0.0:1787383410.714252:0:15306:0:(genops.c:906:class_export_put()) final put ffff963635df9000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787383410.714296:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1787383410.714310:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383410.714314:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787383410.714317:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff963627a38000) has no exports 00000020:00000080:0.0:1787383410.714321:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e11b 00000020:00000080:0.0:1787383410.714324:0:15306:0:(genops.c:906:class_export_put()) final put ffff963635dfa000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787383410.716645:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963635df9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787383410.722351:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963635dfa000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787383410.733479:0:15306:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1787383410.733488:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787383410.733492:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1787383410.733500:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787383410.733556:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383410.733567:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787383410.733597:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383410.733600:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787383410.733607:0:15306:0:(genops.c:906:class_export_put()) final put ffff96363cd27800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787383410.733611:0:15306:0:(genops.c:865:class_export_destroy()) destroying export ffff96363cd27800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787383410.733620:0:15306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787383410.733806:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e106 00000020:00000080:2.0:1787383410.733813:0:15306:0:(genops.c:906:class_export_put()) final put ffff96363cd5b800/lustre-MDD0001_UUID 00000020:01000000:2.0:1787383410.733817:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1787383410.733821:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383410.733826:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787383410.733830:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff96363cd519c0) has no exports 00000020:00000080:2.0:1787383410.733850:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383410.733853:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1787383410.733857:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e10d 00000020:00000080:2.0:1787383410.733860:0:15306:0:(genops.c:906:class_export_put()) final put ffff96363cd5b000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1787383410.733866:0:15306:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9636183cf000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1787383410.733869:0:15306:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9636183cf000 2 00000020:01000004:2.0:1787383410.733872:0:15306:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9636183cf000 from lustre-MDT0001 00000020:00000080:2.0:1787383410.733887:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383410.733901:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1787383410.733904:0:15306:0:(genops.c:906:class_export_put()) final put ffff96363cd25000/lustre-MDT0001_UUID 00000020:00000080:2.0:1787383410.733906:0:15306:0:(genops.c:865:class_export_destroy()) destroying export ffff96363cd25000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1787383410.733912:0:15306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1787383410.733942:0:15306:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1787383410.733946:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1787383410.733949:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383410.733952:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787383410.733958:0:15306:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff96363d875000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787383410.733963:0:15306:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff96363cd54d40) has exports, disconnecting them 00000020:00080000:2.0:1787383410.733968:0:15306:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff96363d875000), last request at 1787383163 00000020:00000080:2.0:1787383410.733971:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e161 00000020:00080000:2.0:1787383410.733982:0:15306:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96363d875000): rc 0 00000020:00000080:2.0:1787383410.733996:0:15306:0:(genops.c:906:class_export_put()) final put ffff96363d875000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787383410.734713:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963635dfb000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787383410.734722:0:13975:0:(genops.c:906:class_export_put()) final put ffff963635dfd000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787383410.734724:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963635dfd000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1787383410.734733:0:13975:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787383410.734843:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363cd5b800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787383410.734846:0:13975:0:(genops.c:906:class_export_put()) final put ffff96363cd21000/lustre-MDD0001_UUID 00000020:00000080:3.0:1787383410.734848:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363cd21000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787383410.734851:0:13975:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787383410.735028:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363cd5b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787383410.735034:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d875000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1787383410.738845:0:15306:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1787383410.738855:0:15306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787383410.738859:0:15306:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787383410.738866:0:15306:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787383410.738901:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363d877800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787383410.739048:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383410.739058:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1787383410.739064:0:15306:0:(genops.c:906:class_export_put()) final put ffff96363cd5a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787383410.739080:0:15306:0:(genops.c:865:class_export_destroy()) destroying export ffff96363cd5a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787383410.739087:0:15306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1787383410.739165:0:15306:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9636183cf000 1 00000020:00000080:3.0:1787383410.739173:0:15306:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e09d 00000020:00000080:3.0:1787383410.739179:0:15306:0:(genops.c:906:class_export_put()) final put ffff963640945800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1787383410.739188:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1787383410.739196:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963640945800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787383410.739206:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383410.739211:0:15306:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787383410.739215:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff963627ae0000) has no exports 00000020:00000080:3.0:1787383410.792589:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383410.792603:0:15306:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787383410.792608:0:15306:0:(genops.c:906:class_export_put()) final put ffff9636183c8800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787383410.792613:0:15306:0:(genops.c:865:class_export_destroy()) destroying export ffff9636183c8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787383410.792624:0:15306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787383410.792762:0:15306:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9636183cc800 00000020:01000000:3.0:1787383410.792838:0:15306:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787383410.792842:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383410.792846:0:15306:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787383410.792850:0:15306:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff963627ae3380) has no exports 00000100:00100000:2.0:1787383410.793097:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff963638b40600:6520] 0 exiting: rc = 1 00000100:00100000:2.0:1787383410.793181:0:9499:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff96350230e400:9499] 3 exiting: rc = 0 00000100:00100000:2.0:1787383410.793254:0:10098:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff96363da53400:10098] 4 exiting: rc = 0 00000100:00100000:0.0:1787383410.793448:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff963638b9a800:6522] 2 exiting: rc = 0 00000100:00100000:1.0:1787383410.793540:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff963638b9ba00:6521] 1 exiting: rc = 0 00000100:00100000:3.0:1787383410.793581:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793590:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793596:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793602:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793608:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793613:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793619:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793625:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793630:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793634:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793640:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793645:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793659:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793665:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793670:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793675:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793680:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793685:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793689:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793694:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793698:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793703:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793708:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793713:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793719:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793724:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793729:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793734:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793740:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.793749:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794043:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794049:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794054:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794058:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794063:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794068:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794073:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794078:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794082:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794087:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794092:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794097:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794102:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794106:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794111:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794115:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794120:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794132:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794136:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794141:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794145:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794150:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794155:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794159:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794165:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794169:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794174:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794181:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794186:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794192:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794203:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794209:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794214:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.794255:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383410.801340:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff963638b9b200:6524] 1 exiting: rc = 0 00000100:00100000:2.0:1787383410.801546:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff963638b9b400:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1787383410.801704:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801713:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801721:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801726:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801732:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801738:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801743:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801749:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801753:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801760:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801790:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801798:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801805:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801811:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801817:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801823:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801828:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801833:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801849:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801854:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801859:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801863:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801868:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801873:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801877:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801882:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801886:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801891:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801895:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801900:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801906:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801910:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801915:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801930:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801936:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801941:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801947:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801953:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801958:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801963:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801973:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801979:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801984:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801988:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801993:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.801997:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802002:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802007:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802011:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802016:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802021:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802025:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802029:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802039:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802044:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802048:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802053:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802057:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802062:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802066:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802071:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802076:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802081:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.802086:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383410.806956:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff963610969c00:6525] 0 exiting: rc = 1 00000100:00100000:0.0:1787383410.812642:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff963610969600:6526] 1 exiting: rc = 0 00000100:00100000:3.0:1787383410.812842:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.812852:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.812888:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.812895:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.812902:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.812907:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.812913:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.812918:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813124:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813131:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813136:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813142:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813147:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813152:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813158:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813163:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813168:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813173:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813178:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813184:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813201:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813207:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813212:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813218:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813233:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813238:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813243:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813248:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813252:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813258:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813264:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813270:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813289:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813392:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813400:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813406:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813412:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813418:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813423:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813429:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813435:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813439:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813445:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813451:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813474:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813480:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813487:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813493:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813499:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813506:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813511:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813517:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813523:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813527:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813533:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813538:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813556:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813562:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813567:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813578:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813583:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813588:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813593:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.813598:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383410.822221:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9636346cfe00:6528] 1 exiting: rc = 0 00000100:00100000:0.0:1787383410.822377:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff96363154b200:6527] 0 exiting: rc = 1 00000100:00100000:3.0:1787383410.822472:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822479:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822485:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822490:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822496:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822501:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822508:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822513:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822518:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822522:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822527:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822532:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822536:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822541:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822546:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822550:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822556:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822561:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822566:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822571:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822575:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822580:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822584:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822589:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822593:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822598:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822602:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822607:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822612:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822618:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822637:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822641:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822646:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822652:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822657:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822662:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822666:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822671:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822676:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822681:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822686:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822692:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822697:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822702:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822707:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822712:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822717:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822721:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822727:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822731:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822736:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822740:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822745:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822749:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822754:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822758:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822799:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822805:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822810:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822814:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822819:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822824:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822829:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.822834:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383410.823246:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff963618bb0800:6530] 1 exiting: rc = 0 00000100:00100000:0.0:1787383410.823348:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff963631336200:6529] 0 exiting: rc = 1 00000100:00100000:3.0:1787383410.823562:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823576:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823580:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823585:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823590:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823594:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823599:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823603:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823608:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823613:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823618:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823623:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823628:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823632:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823637:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823642:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823647:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823651:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823656:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823661:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823666:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823671:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823677:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823682:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823686:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823691:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823696:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823701:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823705:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823711:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823716:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823722:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823727:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823731:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823736:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823741:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823753:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.823758:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824377:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824387:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824392:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824397:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824403:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824409:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824414:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824419:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824426:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824431:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824437:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824441:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824447:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824525:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824531:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824536:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824541:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824547:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824551:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824557:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824562:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824567:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824573:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824578:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824584:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.824589:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383410.828137:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9636108cc000:6532] 1 exiting: rc = 0 00000100:00100000:1.0:1787383410.828296:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff963631337000:6531] 0 exiting: rc = 1 00000100:00100000:3.0:1787383410.828569:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828577:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828582:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828587:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828593:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828598:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828603:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828622:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828628:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828634:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828640:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828646:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828653:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828659:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828665:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828670:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828676:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828682:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828688:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828694:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828699:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828704:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828709:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828714:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828719:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828724:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828729:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828734:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828739:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828744:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828749:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828754:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828759:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828795:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828802:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828807:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828812:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828818:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828823:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828829:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828834:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828840:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828854:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828860:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828866:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828871:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828877:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828883:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828888:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828894:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828900:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828906:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828912:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828918:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828935:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828941:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828946:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828951:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828956:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828962:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828967:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828973:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828983:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.828990:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383410.829534:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff963628eb3000:6533] 0 exiting: rc = 1 00000100:00100000:0.0:1787383410.829676:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff963628eb3600:6534] 1 exiting: rc = 0 00000100:00100000:1.0:1787383410.830100:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9636108ccc00:6535] 2 exiting: rc = 0 00000100:00100000:3.0:1787383410.830561:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830569:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830576:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830582:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830588:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830595:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830601:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830607:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830613:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830618:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830624:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830630:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830635:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830652:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830659:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830665:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830671:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830677:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830684:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830709:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830717:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830724:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830730:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830737:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830743:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830749:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830755:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830761:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830781:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830788:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830794:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830800:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830807:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830813:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830819:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830825:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830832:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830838:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830844:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830849:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830855:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830861:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830867:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830886:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830893:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830900:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830907:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.830913:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831524:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831530:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831538:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831543:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831549:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831554:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831560:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831565:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831570:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831575:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831581:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831588:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831594:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831599:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831605:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383410.831623:0:15306:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787383410.837088:0:15306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383410.837101:0:15306:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787383410.837107:0:15306:0:(genops.c:906:class_export_put()) final put ffff9636313f3800/MDS_uuid 00000020:00000080:3.0:1787383410.837112:0:15306:0:(genops.c:865:class_export_destroy()) destroying export ffff9636313f3800/MDS_uuid for MDS 00000020:01000000:3.0:1787383410.837118:0:15306:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787383410.837266:0:15306:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1787383411.354916:0:15308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383412.379086:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787383412.891213:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) 68140aec-1198-480f-b348-a4187c7bb1d1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787383412.891225:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) 68140aec-1198-480f-b348-a4187c7bb1d1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383412.891229:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787383412.891234:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787383412.891238:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96350233a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787383412.891249:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1787383412.891254:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787383412.891264:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96350233a800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383412.891321:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362da09500 x1874206984937728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787383412.891385:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787383412.891389:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787383412.891405:0:13975:0:(import.c:65:import_set_state_nolock()) ffff963502314800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787383412.891409:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1787383412.891412:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787383412.891416:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff963502314800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383412.891433:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362da0a300 x1874206984937984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383412.891500:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984937856:0@lo:400:kworker.0 00000400:00000100:1.0:1787383412.891558:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984937856 offset 0 length 224: 4 00000100:00100000:0.0:1787383412.892021:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984938112:0@lo:400:kworker.0 00000400:00000100:0.0:1787383412.892077:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984938112 offset 0 length 224: 4 00000100:00100000:3.0:1787383412.893260:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984937728:0@lo:38:kworker.0 00000400:00000100:3.0:1787383412.893410:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984937728 offset 0 length 520: 4 00000100:00100000:3.0:1787383412.893440:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984937984:0@lo:38:kworker.0 00000400:00000100:3.0:1787383412.893458:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984937984 offset 0 length 520: 4 00010000:00010000:1.0:1787383413.402968:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383414.426935:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787383414.512634:0:15508:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787383414.524329:0:15508:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787383414.524412:0:15508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.524452:0:15508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.524460:0:15508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.524467:0:15508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383414.524503:0:15508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787383414.525216:0:15508:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787383414.525268:0:15508:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787383414.525285:0:15508:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96362da09500 x1874206984937728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787383437 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383414.525305:0:15508:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787383414.525312:0:15508:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787383414.525320:0:15508:0:(import.c:65:import_set_state_nolock()) ffff96350233a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787383414.525326:0:15508:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787383414.525329:0:15508:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96362da09500 x1874206984937728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787383437 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383414.525346:0:15508:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787383414.525350:0:15508:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 30s for inflight to error out 00010000:00010000:3.0:1787383414.525696:0:15308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383414.525707:0:15308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.525717:0:15308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0600 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383414.525722:0:15308:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.525748:0:15308:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383414.525756:0:15308:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383414.525805:0:15308:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787383414.525810:0:15308:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787383414.525813:0:15308:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787383414.525832:0:15308:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963620414800 00010000:00010000:3.0:1787383414.525837:0:15308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.525843:0:15308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c0600/0xc40acec91532e4da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e4e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383414.525856:0:15308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.525858:0:15308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383414.525860:0:15308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383414.525901:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984937728:0@lo:38:kworker.0 00000100:00080000:0.0:1787383414.531398:0:15508:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787383414.531426:0:15508:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96362da0b800 x1874206984937856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383428 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383414.531755:0:15508:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787383414.531794:0:15508:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787383414.531836:0:15508:0:(import.c:65:import_set_state_nolock()) ffff963502313800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787383414.531988:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984937856:0@lo:400:kworker.0 00000100:00100000:3.0:1787383414.532004:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1874206984938240:0@lo:39:umount.0 00000400:00000100:3.0:1787383414.532068:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984938240 offset 0 length 224: 4 00010000:00010000:3.0:1787383415.453166:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787383415.899092:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) 68140aec-1198-480f-b348-a4187c7bb1d1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787383415.899107:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) 68140aec-1198-480f-b348-a4187c7bb1d1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383415.899110:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787383415.899138:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787383415.900112:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383415.900144:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984938368:0@lo:400:kworker.0 00000400:00000100:0.0:1787383415.900215:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984938368 offset 0 length 224: 4 00000001:00100000:1.0:1787383415.965217:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787383415.965229:0:8429:0:(genops.c:906:class_export_put()) final put ffff96363d9ca800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787383415.965482:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d9ca800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787383415.965547:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363d9cd000 for lustre-OST0000 00000001:00100000:0.0:1787383415.965931:0:9513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787383415.965938:0:9513:0:(genops.c:906:class_export_put()) final put ffff96363d874800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787383415.965999:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d874800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787383415.966050:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363d9ce800 for lustre-OST0001 00010000:00010000:1.0:1787383416.475154:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383417.499001:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787383417.947722:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) 68140aec-1198-480f-b348-a4187c7bb1d1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787383417.947748:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) 68140aec-1198-480f-b348-a4187c7bb1d1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383417.947752:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787383417.947756:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787383417.948093:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383417.948127:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984938496:0@lo:400:kworker.0 00000400:00000100:2.0:1787383417.948201:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984938496 offset 0 length 224: 4 00010000:00010000:1.0:1787383418.523979:0:15308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383419.547182:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383420.571757:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383420.703408:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383410/real 1787383410] req@ffff963503f6a680 x1874206984937472/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787383420 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383420.703456:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503f6a680 x1874206984937472/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787383420 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787383420.703481:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963620414800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787383420.703515:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787383420.703520:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68140aec-1198-480f-b348-a4187c7bb1d1:3646:1874206984937472:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1787383420.704401:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) 68140aec-1198-480f-b348-a4187c7bb1d1->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383420.704412:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787383420.704416:0:13975:0:(import.c:65:import_set_state_nolock()) ffff963620414800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383420.704423:0:13975:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 443 00000100:00080000:0.0:1787383420.704430:0:13975:0:(import.c:589:import_select_connection()) MGC192.168.203.102@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787383420.704440:0:13975:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import ffff963620414800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383420.704502:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f23800 x1874206984938624/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383420.704535:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383420.704540:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787383420.704997:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68140aec-1198-480f-b348-a4187c7bb1d1:3646:1874206984938624:0@lo:250:kworker.0 00000100:00100000:2.0:1787383420.705046:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984938752:0@lo:400:kworker.0 00000400:00000100:3.0:1787383420.705068:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874206984938624 offset 0 length 520: 4 00000400:00000100:2.0:1787383420.709448:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984938752 offset 0 length 224: 4 00010000:00010000:0.0:1787383421.596986:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383422.619582:0:15308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383423.643055:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383424.667231:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383424.794954:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383414/real 1787383414] req@ffff963503f22300 x1874206984938240/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787383424 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383424.794999:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503f22300 x1874206984938240/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787383424 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787383424.795055:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963502313800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787383424.795080:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1874206984938240:0@lo:39:umount.0 00000100:00080000:0.0:1787383424.795235:0:15508:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787383424.795242:0:15508:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787383424.795249:0:15508:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787383424.796258:0:15508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383424.796288:0:15508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383424.796313:0:15508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383424.796321:0:15508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383424.796359:0:15508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383424.796367:0:15508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383424.796374:0:15508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383424.796380:0:15508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383424.796386:0:15508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383424.796405:0:15508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787383424.796410:0:15508:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787383424.796441:0:15508:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787383424.796447:0:15508:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787383424.796452:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383424.796459:0:15508:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787383424.796466:0:15508:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9636313bb380) has no exports 00000020:00080000:0.0:1787383424.796495:0:15508:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9636313bb380) has no exports 00010000:00010000:2.0:1787383424.798430:0:15307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383424.798471:0:15307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383424.798484:0:15307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fd200 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383424.798489:0:15307:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383424.798503:0:15307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383424.798510:0:15307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383424.798517:0:15307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787383424.798520:0:15307:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787383424.798524:0:15307:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787383424.798548:0:15307:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963620414800 00010000:00010000:2.0:1787383424.798552:0:15307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383424.798559:0:15307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636013fd200/0xc40acec91532e4e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e4ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383424.798579:0:15307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383424.798584:0:15307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383424.798590:0:15307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636102b7800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383424.798593:0:15307:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383424.798610:0:15307:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383424.798616:0:15307:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383424.798621:0:15307:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787383424.798624:0:15307:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787383424.798625:0:15307:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787383424.798633:0:15307:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963620414800 00010000:00010000:2.0:1787383424.798637:0:15307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383424.798642:0:15307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b7800/0xc40acec91532e76c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e773 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383424.798652:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383424.798654:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383424.798656:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383424.799532:0:15308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787383424.800323:0:15508:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9635031e61e0 - data ffff963501c3d6c0/ffff963503505800 00000020:01000000:0.0:1787383424.800463:0:15508:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96363512dde0 - data ffff96362921dca8/ffff963636f8a400 00100000:10000000:0.0:1787383424.815224:0:15508:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787383424.828385:0:15508:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e23a 00000020:00000080:1.0:1787383424.828402:0:15508:0:(genops.c:906:class_export_put()) final put ffff963636f5d000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787383424.828416:0:15508:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96363d95c800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787383424.828420:0:15508:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96363d95c800 2 00000020:01000004:1.0:1787383424.828424:0:15508:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96363d95c800 from lustre-OST0000 00000020:00000080:1.0:1787383424.828454:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787383424.828467:0:15508:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787383424.828469:0:15508:0:(genops.c:906:class_export_put()) final put ffff963636f5a800/lustre-OST0000_UUID 00000020:00000080:1.0:1787383424.828473:0:15508:0:(genops.c:865:class_export_destroy()) destroying export ffff963636f5a800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787383424.828481:0:15508:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787383424.828570:0:15508:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787383424.828576:0:15508:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787383424.828580:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383424.828586:0:15508:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787383424.828596:0:15508:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff96350233c800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787383424.828603:0:15508:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff96363cd53380) has exports, disconnecting them 00000020:00080000:1.0:1787383424.828609:0:15508:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff96350233c800), last request at 1787383181 00000020:00000080:1.0:1787383424.828613:0:15508:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e264 00000020:00080000:1.0:1787383424.828624:0:15508:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96350233c800): rc 0 00000020:00000080:1.0:1787383424.828630:0:15508:0:(genops.c:906:class_export_put()) final put ffff96350233c800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787383424.833076:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963636f5d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787383424.833108:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96350233c800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787383424.833155:0:15508:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787383424.833161:0:15508:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787383424.833167:0:15508:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787383424.833175:0:15508:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787383424.833207:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96350233a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787383424.833409:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383424.833420:0:15508:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787383424.833427:0:15508:0:(genops.c:906:class_export_put()) final put ffff96363d876000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787383424.833446:0:15508:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d876000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787383424.833451:0:15508:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787383424.833551:0:15508:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787383424.833556:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383424.833563:0:15508:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787383424.833571:0:15508:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff963502310800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787383424.833578:0:15508:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff96363cd50000) has exports, disconnecting them 00000020:00080000:2.0:1787383424.833583:0:15508:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff963502310800), last request at 1787383181 00000020:00000080:2.0:1787383424.833588:0:15508:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e279 00000020:00080000:2.0:1787383424.833604:0:15508:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff963502310800): rc 0 00000020:00000080:2.0:1787383424.833610:0:15508:0:(genops.c:906:class_export_put()) final put ffff963502310800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787383424.833645:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963502310800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1787383424.835278:0:15508:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787383424.835289:0:15508:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787383424.835294:0:15508:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787383424.835304:0:15508:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787383424.835502:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383424.835514:0:15508:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1787383424.835524:0:15508:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96363d95c800 1 00000020:00000080:3.0:1787383424.835533:0:15508:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e202 00000020:00000080:3.0:1787383424.835544:0:15508:0:(genops.c:906:class_export_put()) final put ffff963638ada000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787383424.835551:0:15508:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787383424.835557:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383424.835562:0:15508:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787383424.835567:0:15508:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9636313bcd40) has no exports 00000020:00000080:3.0:1787383424.839632:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963502313800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787383424.839655:0:8:0:(genops.c:906:class_export_put()) final put ffff96350233f000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787383424.839659:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96350233f000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787383424.839672:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787383424.839760:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963638ada000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787383424.873553:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383424.873573:0:15508:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787383424.873580:0:15508:0:(genops.c:906:class_export_put()) final put ffff96362d8a9800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787383424.873586:0:15508:0:(genops.c:865:class_export_destroy()) destroying export ffff96362d8a9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787383424.873601:0:15508:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787383424.873788:0:15508:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96362d8aa800 00000020:02000400:3.0:1787383424.873843:0:15508:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787383425.694480:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787383426.203312:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) 68140aec-1198-480f-b348-a4187c7bb1d1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787383426.203326:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) 68140aec-1198-480f-b348-a4187c7bb1d1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383426.203330:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787383426.203334:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787383426.203469:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383426.203517:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984938880:0@lo:400:kworker.0 00000400:00000100:3.0:1787383426.203591:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984938880 offset 0 length 224: 4 00010000:00010000:2.0:1787383426.715304:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383427.739425:0:15307:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1787383428.251997:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383412/real 1787383412] req@ffff96362da08a80 x1874206984938112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787383428 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383428.298007:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff96362da08a80 x1874206984938112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787383428 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787383428.298022:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9635034f1000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787383428.298026:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787383428.318029:0:3647:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1787383428.318131:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 68140aec-1198-480f-b348-a4187c7bb1d1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787383428.318137:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 68140aec-1198-480f-b348-a4187c7bb1d1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383428.318140:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787383428.318144:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383428.318146:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787383428.318159:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787383428.318162:0:8:0:(import.c:65:import_set_state_nolock()) ffff9635034f1000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383428.318171:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 232 00000100:00080000:2.0:1787383428.318181:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9635034f1000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383428.318219:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362d91bb80 x1874206984939008/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787383428.318346:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1874206984939008:0@lo:38:kworker.0 00000400:00000100:3.0:1787383428.318395:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984939008 offset 0 length 520: 4 00000100:00100000:0.0:1787383428.320614:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984938112:0@lo:400:kworker.0 00000020:01000004:0.0:1787383428.652451:0:15710:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787383428.667139:0:15710:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787383428.667303:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383428.667319:0:15710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383428.667327:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383428.667335:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383428.667399:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787383428.667405:0:15710:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787383428.667428:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787383428.667439:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96362da0a300 x1874206984937984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787383437 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383428.667463:0:15710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787383428.667468:0:15710:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787383428.667474:0:15710:0:(import.c:65:import_set_state_nolock()) ffff963502314800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787383428.667477:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787383428.667480:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96362da0a300 x1874206984937984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787383437 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383428.667487:0:15710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787383428.667490:0:15710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:2.0:1787383428.667567:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984937984:0@lo:38:kworker.0 00010000:00010000:1.0:1787383428.667934:0:15308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383428.667942:0:15308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383428.667950:0:15308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383428.667954:0:15308:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383428.667963:0:15308:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383428.667981:0:15308:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383428.667987:0:15308:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787383428.667990:0:15308:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787383428.667992:0:15308:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787383428.668007:0:15308:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963620414800 00010000:00010000:1.0:1787383428.668011:0:15308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383428.668018:0:15308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532e4be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e4c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383428.668028:0:15308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383428.668029:0:15308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383428.668031:0:15308:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787383428.668708:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787383428.668718:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503f69f80 x1874206984938368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383431 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383428.668821:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503f69180 x1874206984938496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383433 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383428.668836:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503f20700 x1874206984938752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383436 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383428.668844:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96362d918000 x1874206984938880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383442 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383428.668855:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96362d91bb80 x1874206984939008/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787383438 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383428.668866:0:15710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787383428.668870:0:15710:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787383428.668875:0:15710:0:(import.c:65:import_set_state_nolock()) ffff9635034f1000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787383428.668878:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787383428.668881:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503f69f80 x1874206984938368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383431 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383428.668922:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984938368:0@lo:400:kworker.0 00000100:00100000:0.0:1787383428.668949:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503f69180 x1874206984938496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383433 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383428.668957:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503f20700 x1874206984938752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383436 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383428.668964:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96362d918000 x1874206984938880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383442 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383428.668971:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96362d91bb80 x1874206984939008/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787383438 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383428.668977:0:15710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787383428.668978:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984938752:0@lo:400:kworker.0 00000100:00100000:3.0:1787383428.669002:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984938880:0@lo:400:kworker.0 00000100:00100000:2.0:1787383428.669081:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1874206984939008:0@lo:38:kworker.0 00000100:00100000:0.0:1787383428.669255:0:15710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1787383428.669270:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984938496:0@lo:400:kworker.0 00010000:00010000:0.0:1787383428.670597:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383428.670614:0:15710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383428.670622:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383428.670628:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383428.670701:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383428.670708:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383428.670715:0:15710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383428.670722:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383428.670727:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383428.670832:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383428.670838:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383428.670846:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fc400 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383428.670850:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383428.670859:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383428.670865:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383428.670870:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787383428.670873:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1787383428.670883:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963620414800 00010000:00010000:2.0:1787383428.670887:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383428.670902:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636013fc400/0xc40acec91532e4cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e4d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383428.670916:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383428.670918:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383428.670923:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6c00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383428.670926:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383428.670943:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383428.670950:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383428.670954:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787383428.670956:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787383428.670960:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963620414800 00010000:00010000:2.0:1787383428.670962:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383428.670968:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383428.670969:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383428.670971:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383428.671144:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787383428.671149:0:15710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636421f6c00/0xc40acec91532e75e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e765 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383428.671162:0:15710:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787383428.671171:0:15710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1787383428.671173:0:15710:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787383428.671204:0:15710:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787383428.671208:0:15710:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787383428.671212:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383428.671217:0:15710:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787383428.671220:0:15710:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff963627a399c0) has no exports 00000020:00080000:0.0:1787383428.671248:0:15710:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff963627a399c0) has no exports 00010000:00010000:2.0:1787383428.673029:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787383428.673405:0:15710:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9635031e6180 - data ffff963629309870/ffff96363da3bc00 00000020:01000000:1.0:1787383428.676000:0:15710:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff963503330ea0 - data ffff963501c785e8/ffff96350206e000 00100000:10000000:1.0:1787383428.693725:0:15710:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787383428.702516:0:15710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e360 00000020:00000080:0.0:1787383428.702527:0:15710:0:(genops.c:906:class_export_put()) final put ffff963503161800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787383428.702591:0:15710:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96350233b000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787383428.702597:0:15710:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96350233b000 2 00000020:01000004:0.0:1787383428.702600:0:15710:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96350233b000 from lustre-OST0001 00000020:00000080:0.0:1787383428.702619:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383428.702629:0:15710:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787383428.702632:0:15710:0:(genops.c:906:class_export_put()) final put ffff963503167800/lustre-OST0001_UUID 00000020:00000080:0.0:1787383428.702635:0:15710:0:(genops.c:865:class_export_destroy()) destroying export ffff963503167800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787383428.702641:0:15710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787383428.702749:0:15710:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 68140aec-1198-480f-b348-a4187c7bb1d1->MGS 00010000:00010000:0.0:1787383428.702792:0:15710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963601655800/0xc40acec91532e0b9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e0c0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383428.702804:0:15710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963601655800/0xc40acec91532e0b9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e0c0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383428.702810:0:15710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787383428.702813:0:15710:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787383428.702816:0:15710:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787383428.702836:0:15710:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963620414800 00010000:00010000:0.0:1787383428.702840:0:15710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963601655800/0xc40acec91532e0b9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e0c0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383428.702855:0:15710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636102b6e00/0xc40acec91532e52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532e535 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383428.702872:0:15710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636102b6e00/0xc40acec91532e52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532e535 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383428.702877:0:15710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787383428.702879:0:15710:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787383428.702881:0:15710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787383428.702890:0:15710:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff963620414800 00010000:00010000:0.0:1787383428.702893:0:15710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636102b6e00/0xc40acec91532e52e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532e535 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787383428.702908:0:15710:0:(import.c:65:import_set_state_nolock()) ffff963620414800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787383428.702912:0:15710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787383428.702915:0:15710:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787383428.702917:0:15710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787383428.702920:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787383428.702940:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503f23800 x1874206984938624/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787383435 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787383428.702955:0:15710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787383428.702958:0:15710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:3.0:1787383428.704512:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963503161800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1787383428.704651:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:68140aec-1198-480f-b348-a4187c7bb1d1:3646:1874206984938624:0@lo:250:kworker.0 10000000:01000000:3.0:1787383428.704753:0:15710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787383428.704762:0:15710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532dfb6 00000020:00000080:3.0:1787383428.704790:0:15710:0:(genops.c:906:class_export_put()) final put ffff9636313f5800/68140aec-1198-480f-b348-a4187c7bb1d1 00000020:01000000:3.0:1787383428.704801:0:15710:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.102@tcp (flags='') 00000020:00000080:3.0:1787383428.704808:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383428.704816:0:15710:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.102@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787383428.704819:0:15710:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9636345a8000) has no exports 10000000:01000000:2.0:1787383428.704885:0:6517:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1787383428.704954:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9636313f5800/68140aec-1198-480f-b348-a4187c7bb1d1 for MGC192.168.203.102@tcp 10000000:01000000:3.0:1787383428.705045:0:15710:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.102@tcp: client import never connected 00000100:00080000:3.0:1787383428.705056:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787383428.705059:0:15710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787383428.705062:0:15710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787383428.705063:0:15710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787383428.705102:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383428.705108:0:15710:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.102@tcp (uuid 68140aec-1198-480f-b348-a4187c7bb1d1) 00000020:01000000:3.0:1787383428.705115:0:15710:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787383428.705119:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383428.705123:0:15710:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787383428.705128:0:15710:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9635034f5000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383428.705133:0:15710:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff9636351b0000) has exports, disconnecting them 00000020:00080000:3.0:1787383428.705138:0:15710:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9635034f5000), last request at 1787383199 00000020:00000080:3.0:1787383428.705142:0:15710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e38a 00000020:00080000:3.0:1787383428.705327:0:15710:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9635034f5000): rc 0 00000020:00000080:3.0:1787383428.705337:0:15710:0:(genops.c:906:class_export_put()) final put ffff9635034f5000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787383428.706072:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963620414800 for MGC192.168.203.102@tcp 00000020:00000080:2.0:1787383428.706082:0:8:0:(genops.c:906:class_export_put()) final put ffff963620417000/68140aec-1198-480f-b348-a4187c7bb1d1 00000020:00000080:2.0:1787383428.706084:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963620417000/68140aec-1198-480f-b348-a4187c7bb1d1 for MGC192.168.203.102@tcp 00000020:01000000:2.0:1787383428.706090:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.102@tcp (68140aec-1198-480f-b348-a4187c7bb1d1) 00000020:00000080:2.0:1787383428.706336:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9635034f5000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787383428.706807:0:15710:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787383428.706811:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787383428.706815:0:15710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787383428.706822:0:15710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787383428.706939:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383428.706947:0:15710:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787383428.706954:0:15710:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787383428.706959:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383428.706963:0:15710:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787383428.706968:0:15710:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff963503166800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787383428.706975:0:15710:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff9636352ccd40) has exports, disconnecting them 00000020:00080000:2.0:1787383428.706980:0:15710:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff963503166800), last request at 1787383199 00000020:00000080:2.0:1787383428.706984:0:15710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e39f 00000020:00080000:2.0:1787383428.706998:0:15710:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff963503166800): rc 0 00000020:00000080:2.0:1787383428.707003:0:15710:0:(genops.c:906:class_export_put()) final put ffff963503166800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1787383428.707638:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963502314800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787383428.707647:0:8:0:(genops.c:906:class_export_put()) final put ffff96363f98d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787383428.707650:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96363f98d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787383428.707656:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787383428.707715:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963503166800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1787383428.719838:0:15710:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787383428.719847:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787383428.719851:0:15710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787383428.719859:0:15710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787383428.719893:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9635034f1000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1787383428.720182:0:15307:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787383428.725884:0:15308:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787383428.726132:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1787383428.726382:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1787383428.726549:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff96363107e200:6502] 0 exiting: rc = 1 00000100:00100000:2.0:1787383428.726560:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff963638ba7600:6503] 1 exiting: rc = 0 00000100:00100000:3.0:1787383428.726621:0:10396:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff963503696a00:10396] 2 exiting: rc = 0 00000100:00100000:0.0:1787383428.726703:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.727023:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9636346e8600:6505] 1 exiting: rc = 0 00000100:00100000:0.0:1787383428.727862:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9636346e9000:6506] 2 exiting: rc = 0 00000100:00100000:0.0:1787383428.727933:0:7461:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff963635279000:7461] 3 exiting: rc = 0 00000100:00100000:2.0:1787383428.729971:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff963638ba7400:6504] 0 exiting: rc = 1 00000100:00100000:3.0:1787383428.730371:0:8450:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff96350204fe00:8450] 4 exiting: rc = 0 00000100:00100000:0.0:1787383428.730432:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730444:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730450:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730456:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730463:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730469:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730475:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730481:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730487:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730492:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730499:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730505:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730512:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730519:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730525:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730531:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730537:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730544:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730550:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730557:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730563:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730568:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730574:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730579:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730584:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730589:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730594:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730599:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730604:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730608:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730613:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730618:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730635:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730640:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730645:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730650:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730654:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730660:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730666:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730671:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730676:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730681:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730686:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730692:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730698:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730704:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730708:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730714:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730719:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730724:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730729:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730735:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730740:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730745:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730750:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730755:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730760:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730789:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730795:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730800:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730805:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730810:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730815:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.730820:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787383428.733947:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383428.733960:0:15710:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1787383428.733966:0:15710:0:(genops.c:906:class_export_put()) final put ffff963503116800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1787383428.733981:0:15710:0:(genops.c:865:class_export_destroy()) destroying export ffff963503116800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1787383428.733986:0:15710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1787383428.734037:0:15710:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96350233b000 1 00000020:00000080:0.0:1787383428.734043:0:15710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532e32f 00000020:00000080:0.0:1787383428.734049:0:15710:0:(genops.c:906:class_export_put()) final put ffff96363d9c9000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787383428.734068:0:15710:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787383428.734072:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383428.734077:0:15710:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787383428.734081:0:15710:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff96350273b380) has no exports 00000020:00000080:3.0:1787383428.735315:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d9c9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787383428.767723:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383428.767739:0:15710:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787383428.767748:0:15710:0:(genops.c:906:class_export_put()) final put ffff96363d9cd800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787383428.767752:0:15710:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d9cd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787383428.767759:0:15710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787383428.768311:0:15710:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96363d9c8000 00000020:01000000:2.0:1787383428.768342:0:15710:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787383428.768346:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383428.768350:0:15710:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787383428.768354:0:15710:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9636351b4d40) has no exports 00000020:00000080:2.0:1787383428.768387:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383428.768393:0:15710:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787383428.768396:0:15710:0:(genops.c:906:class_export_put()) final put ffff963638adb800/OSS_uuid 00000020:00000080:2.0:1787383428.768398:0:15710:0:(genops.c:865:class_export_destroy()) destroying export ffff963638adb800/OSS_uuid for OSS 00000020:01000000:2.0:1787383428.768402:0:15710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787383428.768633:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff96363d8f0600:8434] 0 exiting: rc = 1 00000100:00100000:2.0:1787383428.768717:0:8914:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff96350204ec00:8914] 3 exiting: rc = 0 00000100:00080000:0.0:1787383428.768981:0:6516:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787383428.769086:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff96363524c000:8436] 2 exiting: rc = 0 00000100:00100000:1.0:1787383428.769312:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff96363524c400:8435] 1 exiting: rc = 0 00000100:00100000:2.0:1787383428.769357:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769368:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769373:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769380:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769385:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769389:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769394:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769398:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769403:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769407:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769411:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769415:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769420:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769425:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769430:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769446:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769451:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769456:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769462:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769467:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769472:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769477:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769483:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769487:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769493:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769498:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769503:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769508:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769514:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769519:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769525:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769530:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769534:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769539:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769558:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769564:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769569:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769574:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769579:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769584:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769589:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769595:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769600:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769604:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769609:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769613:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769618:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769623:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769628:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769634:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769646:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769651:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769656:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769661:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769665:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769670:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769674:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769679:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769683:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769687:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769692:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769697:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769702:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.769706:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383428.771825:0:13816:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff963503d38000:13816] 2 exiting: rc = 0 00000100:00100000:3.0:1787383428.771828:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff963631381400:8437] 0 exiting: rc = 1 00000100:00100000:0.0:1787383428.771941:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff96363d8cb400:8438] 1 exiting: rc = 0 00000100:00100000:3.0:1787383428.774628:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774639:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774647:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774653:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774658:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774663:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774669:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774674:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774679:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774684:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774689:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774694:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774699:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774704:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774709:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774714:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774718:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774723:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774728:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774733:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774738:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774743:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774748:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774753:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774759:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774791:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774799:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774817:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774821:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774826:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774830:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774835:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774840:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774845:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774850:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774854:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774858:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774863:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774867:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774871:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774876:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774880:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774885:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774890:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774895:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774900:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774905:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774910:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774915:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774920:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774924:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774929:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774935:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774940:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774945:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774950:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774956:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774961:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774966:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774977:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774983:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.774988:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.775002:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.775007:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.775973:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff96363d8f7800:8441] 2 exiting: rc = 0 00000100:00100000:1.0:1787383428.776283:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff96363d8f6a00:8439] 0 exiting: rc = 1 00000100:00100000:2.0:1787383428.776505:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff96363d8f6c00:8440] 1 exiting: rc = 0 00000100:00100000:3.0:1787383428.776607:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776615:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776620:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776626:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776632:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776645:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776652:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776657:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776663:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776669:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776674:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776680:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776686:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776692:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776697:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776702:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776974:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776983:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776990:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.776996:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777001:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777007:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777023:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777029:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777035:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777042:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777047:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777052:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777057:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777063:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777067:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777072:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777077:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777093:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777098:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777104:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777110:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777115:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777119:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777124:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777129:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777133:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777138:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777143:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777148:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777475:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777497:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777504:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777509:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777514:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777519:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777524:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777530:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777536:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777541:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777546:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777552:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777558:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777563:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777569:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777574:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777581:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777586:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.777593:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383428.789668:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff96363ccc3c00:8443] 1 exiting: rc = 0 00000100:00100000:0.0:1787383428.789908:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff963635276200:8442] 0 exiting: rc = 1 00000100:00100000:2.0:1787383428.790001:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790009:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790014:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790020:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790025:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790030:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790036:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790041:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790046:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790051:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790056:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790061:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790066:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790072:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790077:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790082:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790088:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790094:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790099:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790105:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790124:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790129:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790135:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790140:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790145:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790161:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790167:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790172:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790177:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790182:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790186:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790347:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790357:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790364:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790370:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790377:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790383:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790390:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790396:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790402:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790408:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790414:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790421:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790427:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790433:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790438:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790443:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790450:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790456:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790462:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790468:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790473:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790490:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790496:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790502:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790515:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790521:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790526:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790532:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790537:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790542:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790548:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790553:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383428.790559:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383428.792012:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff96363d866400:8444] 0 exiting: rc = 1 00000100:00100000:1.0:1787383428.794043:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff963635270800:8445] 1 exiting: rc = 0 00000100:00100000:3.0:1787383428.795090:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795099:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795116:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795139:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795167:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795175:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795181:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795188:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795194:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795200:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795206:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795213:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795220:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795227:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795234:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795265:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795273:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795279:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795286:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795293:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795299:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795307:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795314:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795321:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795328:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795335:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795342:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795362:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795369:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795375:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795381:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795387:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795393:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795400:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795407:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795413:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795420:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795425:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795431:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795458:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795465:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795471:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795478:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795484:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795491:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795496:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795503:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795510:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795516:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795522:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795527:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795549:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795555:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795561:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795567:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795573:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795579:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795585:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795591:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795596:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795602:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795616:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795622:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383428.795629:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787383428.814114:0:15710:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787383446.459188:0:16474:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787383456.314868:0:17073:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787383456.314874:0:17073:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787383456.314876:0:17073:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787383456.314983:0:17073:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff963620e92000 00000020:01000004:3.0:1787383456.315124:0:17073:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787383456.315131:0:17073:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787383456.315145:0:17073:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff963502738000) 00000020:00000080:3.0:1787383456.315160:0:17073:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787383456.369179:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787383456.371658:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787383456.373916:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787383456.374540:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787383456.374843:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787383456.375126:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787383456.375479:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1787383456.375668:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787383456.376070:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.376459:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787383456.377079:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787383456.377296:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.377561:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787383456.377737:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787383456.378227:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787383456.378451:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787383456.378665:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.378930:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.379334:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.379514:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.379959:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.380370:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787383456.380607:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.380869:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.381233:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.381412:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787383456.381594:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.381925:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.382323:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787383456.382533:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787383456.382866:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.383302:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787383456.383591:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787383456.383848:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787383456.385480:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787383456.386976:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787383456.387323:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787383456.388259:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787383456.388672:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1787383456.389066:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787383456.389315:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787383456.389540:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787383456.389915:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787383456.390296:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1787383456.390477:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787383456.390708:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787383456.391082:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787383456.391586:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787383456.392136:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787383456.392364:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1787383456.393117:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787383456.393316:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1787383456.393519:0:17073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1787383456.394435:0:17073:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787383456.395181:0:17073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787383456.395195:0:17073:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787383456.395208:0:17073:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532f573 00000020:01000004:2.0:1787383456.395214:0:17073:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787383456.395219:0:17073:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787383456.395224:0:17073:0:(tgt_mount.c:101:server_register_mount()) register mount ffff963620e92000 from MGS 00000020:01000004:2.0:1787383456.395228:0:17073:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787383456.395238:0:17073:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9635033c19c0) 00000020:00000080:2.0:1787383456.395248:0:17073:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787383456.395306:0:17073:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963620e92000 from MGS, refs=2 00080000:01000000:2.0:1787383456.395311:0:17073:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787383456.395317:0:17073:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532f581 00000100:00100000:2.0:1787383456.395407:0:17073:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787383456.395516:0:17073:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787383456.395522:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787383456.396178:0:17073:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787383456.396186:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787383456.397151:0:17073:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787383456.397305:0:17073:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787383456.397311:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787383456.398242:0:17073:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787383456.398250:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787383456.398505:0:17073:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787383456.398512:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787383456.399392:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383456.399402:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383456.399404:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383456.399651:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383456.399654:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383456.399656:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383456.400480:0:17073:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787383456.404215:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787383456.406200:0:17073:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787383456.406968:0:17085:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787383456.407018:0:17073:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787383456.407059:0:17073:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787383456.407737:0:17073:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787383456.408198:0:17073:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383456.408327:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787383456.408333:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787383456.409320:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787383456.409330:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787383456.414906:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787383456.414918:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787383456.422919:0:17073:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787383456.422942:0:17073:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.102@tcp' 00000020:01000004:1.0:1787383456.422944:0:17073:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787383456.422973:0:17073:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.102@tcp (typ=mgc) 00000020:00000080:1.0:1787383456.422985:0:17073:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.102@tcp (ffff9636352cb380) 00000020:00000080:1.0:1787383456.423001:0:17073:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787383456.423338:0:17073:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96363d9cf800@MGC192.168.203.102@tcp: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1787383456.423487:0:17073:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.102@tcp-0 is initialized 00000040:01000000:1.0:1787383456.423493:0:17073:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787383456.425265:0:17090:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787383456.426285:0:17091:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787383456.426406:0:17073:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.102@tcp (uuid 98408fb2-7fed-492b-911f-46eabbf1f8e3) 00000020:00000080:3.0:1787383456.426428:0:17073:0:(genops.c:1406:class_connect()) connect: client 98408fb2-7fed-492b-911f-46eabbf1f8e3, cookie 0xc40acec91532f58f 00000100:00080000:3.0:1787383456.426440:0:17073:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787383456.426447:0:17073:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import ffff96363d9cf800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383456.426482:0:17073:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f6ad80 x1874206984939136/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787383456.426504:0:17073:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS 00000020:01000004:3.0:1787383456.426523:0:17073:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787383456.426528:0:17073:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787383456.426541:0:17073:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9635027399c0) 00000100:00100000:2.0:1787383456.426547:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:98408fb2-7fed-492b-911f-46eabbf1f8e3:3646:1874206984939136:0@lo:250:mount.lustre.0 00000020:00000080:3.0:1787383456.426551:0:17073:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787383456.426610:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383456.437155:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984939136 00000100:00100000:1.0:1787383456.437171:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984939136 00000100:00100000:1.0:1787383456.437220:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383456.437229:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1874206984939136:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787383456.437260:0:17086:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 98408fb2-7fed-492b-911f-46eabbf1f8e3@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:1.0:1787383456.437292:0:17086:0:(genops.c:1406:class_connect()) connect: client 98408fb2-7fed-492b-911f-46eabbf1f8e3, cookie 0xc40acec91532f59d 00000100:00080000:1.0:1787383456.437435:0:17086:0:(import.c:65:import_set_state_nolock()) ffff96363d9c9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383456.437524:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+5:3646:x1874206984939136:12345-0@lo:250:mount.lustre.0 Request processed in 293us (10912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383456.437543:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383456.437611:0:3646:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787383456.437620:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.102@tcp: connect to target with instance 0 00000100:00080000:1.0:1787383456.437628:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787383456.437632:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787383456.437637:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363d9cf800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787383456.437640:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787383456.437650:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787383456.437656:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:98408fb2-7fed-492b-911f-46eabbf1f8e3:3646:1874206984939136:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787383456.445938:0:17073:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383456.446966:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787383456.447167:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787383456.449624:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787383456.449638:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787383456.450129:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787383456.450135:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787383456.451095:0:17073:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383456.451243:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787383456.451247:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787383456.451662:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787383456.451668:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787383456.495105:0:17073:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383456.495289:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787383456.495303:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787383456.501331:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787383456.501347:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787383456.502517:0:17073:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383456.502815:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787383456.502821:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787383456.503405:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787383456.503414:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787383456.504046:0:17073:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383456.504920:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787383456.504927:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787383456.508753:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787383456.508786:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787383456.509365:0:17073:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383456.509532:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787383456.509550:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787383456.510126:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787383456.510133:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787383456.531939:0:17073:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787383456.533529:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787383456.533622:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787383456.534967:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787383456.534978:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787383456.535885:0:17073:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787383456.535894:0:17073:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787383456.536583:0:17073:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787383456.536611:0:17073:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787383456.536617:0:17073:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787383456.536717:0:17073:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787383456.536751:0:17073:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.102@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787383456.536755:0:17073:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787383456.536757:0:17073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787383456.536758:0:17073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383456.536760:0:17073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383456.536761:0:17073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383456.536868:0:17073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383456.536870:0:17073:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787383456.536872:0:17073:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787383456.536873:0:17073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383456.536874:0:17073:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787383456.536877:0:17073:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787383456.536879:0:17073:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787383456.536881:0:17073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787383456.536882:0:17073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383456.536883:0:17073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383456.536884:0:17073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383456.536885:0:17073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383456.536885:0:17073:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787383456.536886:0:17073:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787383456.536887:0:17073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383456.536888:0:17073:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787383456.536912:0:17073:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787383456.536931:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984939264:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787383456.536993:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383456.537129:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503723a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383456.537189:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984939264 00000100:00100000:0.0:1787383456.537195:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984939264 00000100:00100000:0.0:1787383456.537260:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383456.537269:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+5:17073:x1874206984939264:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787383456.537312:0:17089:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787383456.537315:0:17089:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787383456.537317:0:17089:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787383456.537685:0:17110:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787383456.538206:0:17089:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1787383456.539722:0:17111:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787383456.539729:0:17111:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787383456.539731:0:17111:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787383456.539733:0:17111:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787383456.539956:0:17111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787383456.540194:0:17089:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787383456.540204:0:17089:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787383456.541725:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+5:17073:x1874206984939264:12345-0@lo:253:mount.lustre.0 Request processed in 4449us (4724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383456.541743:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383456.541892:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984939264:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787383456.541907:0:17073:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787383456.541911:0:17073:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787383456.541912:0:17073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787383456.541914:0:17073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383456.541915:0:17073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383456.541917:0:17073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383456.541918:0:17073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383456.541919:0:17073:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787383456.541920:0:17073:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787383456.541922:0:17073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383456.541923:0:17073:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787383456.541940:0:17073:0:(tgt_mount.c:101:server_register_mount()) register mount ffff963620e92000 from lustre-MDT0000 10000000:01000000:0.0:1787383456.541967:0:17073:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787383456.541970:0:17073:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787383456.541975:0:17073:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9636352cb380 10000000:01000000:0.0:1787383456.541978:0:17073:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383456.542056:0:17073:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9636352cb380 from 1 10000000:01000000:0.0:1787383456.542060:0:17073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787383456.542099:0:17073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.542110:0:17073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.542131:0:17073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383456.542152:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984939392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383456.542189:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.542269:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618bd5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383456.542308:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984939392 00000100:00100000:1.0:1787383456.542315:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984939392 00000100:00100000:1.0:1787383456.542400:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383456.542410:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+5:17073:x1874206984939392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383456.542422:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383456.542442:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96360516c400/0xc40acec91532f5ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f5a4 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.542464:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96360516c400/0xc40acec91532f5ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f5a4 expref: 6 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.542474:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96360516c400/0xc40acec91532f5ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f5a4 expref: 6 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.542483:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96360516c400, rc 0) 00000100:00100000:1.0:1787383456.542527:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+6:17073:x1874206984939392:12345-0@lo:101:mount.lustre.0 Request processed in 119us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383456.542534:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383456.542590:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984939392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383456.542603:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.542613:0:17073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383456.542662:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984939520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383456.542688:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.543059:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618bd5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383456.543185:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984939520 00000100:00100000:1.0:1787383456.543191:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984939520 00000100:00100000:1.0:1787383456.543214:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383456.543219:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+6:17073:x1874206984939520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383456.543301:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+6:17073:x1874206984939520:12345-0@lo:501:mount.lustre.0 Request processed in 81us (611us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787383456.543308:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383456.543400:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984939520:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787383456.543429:0:17073:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787383456.543448:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.543457:0:17073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383456.543466:0:17073:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff963620e92000 10000000:01000000:0.0:1787383456.543471:0:17073:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787383456.543481:0:17073:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff963620e92000 10000000:01000000:0.0:1787383456.543484:0:17073:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787383456.543487:0:17073:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff963620e92000 from 1 10000000:01000000:0.0:1787383456.543490:0:17073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787383456.543511:0:17073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.543519:0:17073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.543527:0:17073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383456.543540:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984939648:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383456.543568:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.543580:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618bd5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383456.543634:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984939648 00000100:00100000:1.0:1787383456.543638:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984939648 00000100:00100000:1.0:1787383456.543655:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383456.543660:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+6:17073:x1874206984939648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383456.543668:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383456.543678:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96360516c800/0xc40acec91532f5b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f5b2 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.543693:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96360516c800/0xc40acec91532f5b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f5b2 expref: 7 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.543710:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96360516c800/0xc40acec91532f5b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f5b2 expref: 7 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.543719:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96360516c800, rc 0) 00000100:00100000:1.0:1787383456.543752:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+7:17073:x1874206984939648:12345-0@lo:101:mount.lustre.0 Request processed in 92us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383456.543758:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787383456.543865:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984939648:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383456.543876:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.543885:0:17073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383456.543896:0:17073:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787383456.543902:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.543909:0:17073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383456.543924:0:17073:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787383456.543928:0:17073:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383456.543932:0:17073:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff963620e92000 10000000:01000000:0.0:1787383456.543935:0:17073:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787383456.543938:0:17073:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787383456.543940:0:17073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787383456.543954:0:17073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.543961:0:17073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.543969:0:17073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383456.543980:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984939776:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383456.544018:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.544035:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618bd5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383456.544095:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984939776 00000100:00100000:1.0:1787383456.544099:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984939776 00000100:00100000:1.0:1787383456.544118:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383456.544123:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+7:17073:x1874206984939776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383456.544130:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383456.544137:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96360516d800/0xc40acec91532f5c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f5c0 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.544151:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96360516d800/0xc40acec91532f5c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f5c0 expref: 8 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.544158:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96360516d800/0xc40acec91532f5c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f5c0 expref: 8 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.544164:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96360516d800, rc 0) 00000100:00100000:1.0:1787383456.544198:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+8:17073:x1874206984939776:12345-0@lo:101:mount.lustre.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383456.544204:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383456.544365:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984939776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383456.544376:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.544383:0:17073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383456.544427:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984939904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383456.544454:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.544518:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618bd5900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383456.544574:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984939904 00000100:00100000:2.0:1787383456.544579:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984939904 00000100:00100000:3.0:1787383456.544990:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383456.545000:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+8:17073:x1874206984939904:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383456.545302:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+9:17073:x1874206984939904:12345-0@lo:501:mount.lustre.0 Request processed in 302us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383456.545444:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787383456.545713:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984939904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383456.545751:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984940032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383456.545922:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.545953:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618bd5900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383456.545996:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984940032 00000100:00100000:3.0:1787383456.546000:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984940032 00000100:00100000:3.0:1787383456.546034:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383456.546042:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+9:17073:x1874206984940032:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383456.550811:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+9:17073:x1874206984940032:12345-0@lo:503:mount.lustre.0 Request processed in 4759us (4879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383456.550826:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383456.551188:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984940032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383456.555840:0:17112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17112:1874206984940160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383456.555923:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.555964:0:17112:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618bd5240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383456.556117:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984940160 00000100:00100000:3.0:1787383456.556125:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984940160 00000100:00100000:3.0:1787383456.556178:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383456.556188:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+9:17112:x1874206984940160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383456.556915:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+9:17112:x1874206984940160:12345-0@lo:502:llog_process_th.0 Request processed in 725us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383456.556935:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787383456.557151:0:17112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17112:1874206984940160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383456.557181:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383456.557192:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.557194:0:17112:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787383456.557199:0:17112:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787383456.557202:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383456.557217:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff963503703380) 00000020:00000080:0.0:1787383456.557230:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787383456.557235:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787383456.557321:0:17112:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787383456.557328:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532f5d5 00000020:00000080:0.0:1787383456.557531:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787383456.557583:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383456.557588:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.557590:0:17112:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787383456.557593:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383456.557597:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.557598:0:17112:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787383456.557601:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383456.557614:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff963503700000) 00000020:00000080:0.0:1787383456.557623:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787383456.557628:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787383456.557630:0:17112:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787383456.557633:0:17112:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787383456.557638:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787383456.557679:0:17112:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963620e92000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787383456.557689:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9635037019c0) 00000020:00000080:0.0:1787383456.557696:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787383456.557754:0:17112:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787383456.557760:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532f5ea 00000020:00000080:0.0:1787383456.557897:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787383456.557903:0:17112:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787383456.557908:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc40acec91532f5f1 00080000:01000000:0.0:1787383456.557912:0:17112:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787383456.557916:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532f5f8 00010000:00010000:3.0:1787383456.665978:0:17112:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787383456.667105:0:17112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1787383456.667427:0:17112:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787383456.670638:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9635033c4d40) 00000020:00000080:2.0:1787383456.670663:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787383456.671381:0:17112:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787383456.671394:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532f606 00000020:00000080:2.0:1787383456.672121:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787383456.675072:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc40acec91532f60d 00000020:00000080:1.0:1787383456.676111:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787383456.676123:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383456.676135:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383456.676138:0:17112:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787383456.676142:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787383456.676145:0:17112:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787383456.676147:0:17112:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383456.676149:0:17112:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383456.676150:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787383456.676152:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383456.676154:0:17112:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787383456.676156:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383456.676159:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383456.676161:0:17112:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787383456.676164:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787383456.676209:0:17112:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787383456.676230:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383456.676233:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383456.676234:0:17112:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787383456.676236:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383456.676239:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383456.676240:0:17112:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787383456.676243:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787383456.676249:0:17112:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:00000080:1.0:1787383456.676277:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787383456.676293:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9636352c8000) 00000020:00000080:1.0:1787383456.676307:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787383456.676312:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787383456.676379:0:17112:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787383456.676385:0:17112:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787383456.676395:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532f61b 00010000:00080000:1.0:1787383456.676424:0:17112:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96363f98c800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1787383456.682159:0:17112:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1787383456.688689:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787383456.688706:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787383456.688797:0:17112:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787383456.688821:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532f622 00000100:00080000:0.0:1787383456.688832:0:17112:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383456.688839:0:17112:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96363f98c800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383456.688875:0:17112:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f20e00 x1874206984940288/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383456.688893:0:17112:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787383456.689110:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984940288:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787383456.689191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383456.689271:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984940288 00000100:00100000:1.0:1787383456.689279:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984940288 00000100:00100000:1.0:1787383456.689322:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383456.689329:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206984940288:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1787383456.689345:0:17099:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:0.0:1787383456.689618:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383456.689623:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.689626:0:17112:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1787383456.689629:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787383456.689631:0:17112:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1787383456.689633:0:17112:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787383456.689635:0:17112:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787383456.689643:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787383456.689647:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.689649:0:17112:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787383456.689651:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787383456.689658:0:17112:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787383456.689661:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.689663:0:17112:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787383456.689667:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787383456.689671:0:17112:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:0.0:1787383456.689690:0:17112:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787383456.689693:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383456.689706:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff963503704d40) 00000020:00000080:0.0:1787383456.689718:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787383456.689723:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787383456.689815:0:17112:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787383456.689821:0:17112:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787383456.689828:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532f630 00010000:00080000:0.0:1787383456.689853:0:17112:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96363d874000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1787383456.692291:0:17112:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787383456.699107:0:17112:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787383456.699551:0:17112:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787383456.704648:0:17112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383456.705439:0:17112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787383456.717157:0:17112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787383456.733296:0:17118:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787383456.733305:0:17118:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1787383456.734502:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206984940288:12345-0@lo:38:llog_process_th.0 Request processed in 45167us (45306us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787383456.734519:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787383456.734869:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363f98c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383456.734876:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787383456.734880:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984940288:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1787383456.737115:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787383456.737132:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787383456.737179:0:17112:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787383456.737199:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532f637 00000100:00080000:0.0:1787383456.737209:0:17112:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383456.737215:0:17112:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96363d874000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383456.737248:0:17112:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f21f80 x1874206984940416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383456.737277:0:17112:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787383456.737335:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383456.737339:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.737341:0:17112:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787383456.737343:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787383456.737346:0:17112:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1787383456.737347:0:17112:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787383456.737348:0:17112:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787383456.737350:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787383456.737352:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.737354:0:17112:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787383456.737356:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787383456.737360:0:17112:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787383456.737364:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.737365:0:17112:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787383456.737368:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787383456.737371:0:17112:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:0.0:1787383456.737392:0:17112:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787383456.737394:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383456.737406:0:17112:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9636345a8000) 00000020:00000080:0.0:1787383456.737418:0:17112:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1787383456.737423:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787383456.737551:0:17112:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787383456.737557:0:17112:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1787383456.737563:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532f645 00010000:00080000:0.0:1787383456.737590:0:17112:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963635dfd800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1787383456.737798:0:17112:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787383456.737868:0:17112:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787383456.737881:0:17112:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1787383456.738024:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984940416:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787383456.738082:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206984940416 offset 0 length 520: 4 00000040:00080000:3.0:1787383456.741239:0:17112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383456.741423:0:17112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787383456.744423:0:17112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787383456.746385:0:17120:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787383456.746392:0:17120:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787383456.757256:0:17112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787383456.757272:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787383456.757318:0:17112:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787383456.757338:0:17112:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532f64c 00000100:00080000:3.0:1787383456.757349:0:17112:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787383456.757355:0:17112:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff963635dfd800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383456.757413:0:17112:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f68380 x1874206984940544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383456.757490:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984940544:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787383456.757543:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206984940544 offset 0 length 520: 4 00000100:00080000:3.0:1787383456.757594:0:17112:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787383456.757654:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383456.757658:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383456.757660:0:17112:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787383456.757663:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383456.757667:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383456.757669:0:17112:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787383456.757672:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787383456.757674:0:17112:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787383456.757676:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383456.757678:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383456.757680:0:17112:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787383456.757690:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383456.757693:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383456.757695:0:17112:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787383456.757698:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787383456.757742:0:17112:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17112:1874206984940672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383456.757823:0:17112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383456.757843:0:17112:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503723900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383456.757862:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984940672 00000100:00100000:3.0:1787383456.757868:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984940672 00000100:00100000:3.0:1787383456.757905:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383456.757926:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+9:17112:x1874206984940672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383456.758346:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+9:17112:x1874206984940672:12345-0@lo:502:llog_process_th.0 Request processed in 421us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383456.758355:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383456.758411:0:17112:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17112:1874206984940672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787383456.758436:0:17112:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383456.758441:0:17112:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383456.758442:0:17112:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787383456.758446:0:17112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787383456.758549:0:17073:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787383456.758567:0:17073:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787383456.758581:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383456.758592:0:17073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383456.758600:0:17073:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff963620e92000 from 1 10000000:01000000:3.0:1787383456.758603:0:17073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787383456.758633:0:17073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383456.758641:0:17073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383456.758649:0:17073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383456.758662:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984940800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787383456.758688:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383456.758700:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503723900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383456.759960:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984940800 00000100:00100000:1.0:1787383456.759972:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984940800 00000100:00100000:1.0:1787383456.760030:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787383456.760039:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+9:17073:x1874206984940800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383456.760063:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383456.760082:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96360516c600/0xc40acec91532f65a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f653 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.760105:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96360516c600/0xc40acec91532f65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f653 expref: 10 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.760116:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96360516c600/0xc40acec91532f65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f653 expref: 10 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.760138:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96360516c600, rc 0) 00000100:00100000:1.0:1787383456.760204:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+10:17073:x1874206984940800:12345-0@lo:101:mount.lustre.0 Request processed in 165us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383456.760209:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787383456.760391:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984940800:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383456.760416:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f65a expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.760425:0:17073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f65a expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383456.761128:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984940928:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787383456.761182:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.761222:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963628fa0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787383456.761469:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984940928 00000100:00100000:2.0:1787383456.761475:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984940928 00000100:00100000:2.0:1787383456.761514:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383456.761523:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+10:17073:x1874206984940928:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787383456.761540:0:17086:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787383456.761546:0:17086:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787383456.761626:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+10:17073:x1874206984940928:12345-0@lo:256:mount.lustre.0 Request processed in 104us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383456.761633:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383456.762278:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984940928:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787383456.763308:0:17073:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787383456.763328:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f65a expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.763339:0:17073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f65a expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383456.763347:0:17073:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff963620e92000 from 1 10000000:01000000:0.0:1787383456.763350:0:17073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383456.763384:0:17073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.763392:0:17073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.763402:0:17073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383456.763422:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984941056:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383456.763478:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.763516:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963628fa0180 going to sleep for 11 seconds 00000100:00100000:1.0:1787383456.763689:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984941056 00000100:00100000:1.0:1787383456.763696:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984941056 00000100:00100000:1.0:1787383456.763748:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787383456.763755:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+10:17073:x1874206984941056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383456.763780:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383456.763794:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96360516cc00/0xc40acec91532f668 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f661 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.763814:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96360516cc00/0xc40acec91532f668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f661 expref: 11 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.763824:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96360516cc00/0xc40acec91532f668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f661 expref: 11 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.763832:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96360516cc00, rc 0) 00000100:00100000:1.0:1787383456.763865:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+11:17073:x1874206984941056:12345-0@lo:101:mount.lustre.0 Request processed in 110us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383456.763871:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787383456.764289:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984941056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383456.764302:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f668 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383456.764311:0:17073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f668 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383456.764383:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984941184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383456.764411:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.764447:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963628fa0180 going to sleep for 11 seconds 00000100:00100000:1.0:1787383456.768931:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984941184 00000100:00100000:1.0:1787383456.768948:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984941184 00000100:00100000:1.0:1787383456.769145:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787383456.769156:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+11:17073:x1874206984941184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383456.769347:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+11:17073:x1874206984941184:12345-0@lo:501:mount.lustre.0 Request processed in 192us (4933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383456.769375:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787383456.769673:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984941184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383456.769725:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984941312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383456.769815:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.769849:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963628fa0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787383456.769927:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984941312 00000100:00100000:2.0:1787383456.769933:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984941312 00000100:00100000:2.0:1787383456.769971:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383456.769978:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+11:17073:x1874206984941312:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383456.770095:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+11:17073:x1874206984941312:12345-0@lo:503:mount.lustre.0 Request processed in 117us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383456.770103:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383456.770570:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984941312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383456.771710:0:17122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17122:1874206984941440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383456.772058:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.772126:0:17122:0:(client.c:2702:ptlrpc_set_wait()) set ffff963628fa0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383456.772163:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984941440 00000100:00100000:2.0:1787383456.772169:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984941440 00000100:00100000:2.0:1787383456.772233:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383456.772242:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+11:17122:x1874206984941440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383456.772798:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+11:17122:x1874206984941440:12345-0@lo:502:llog_process_th.0 Request processed in 555us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383456.772809:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383456.773464:0:17122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17122:1874206984941440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383456.773500:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383456.773511:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.773514:0:17122:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787383456.773522:0:17122:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff963620e92000 00000020:00000080:0.0:1787383456.773531:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383456.773540:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383456.773543:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.773545:0:17122:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787383456.773547:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383456.773550:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.773551:0:17122:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787383456.773554:0:17122:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff963620e92000 00000020:00000080:0.0:1787383456.773556:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383456.773618:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383456.773622:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.773623:0:17122:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787383456.773625:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383456.773627:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.773629:0:17122:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383456.773632:0:17122:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963620e92000 00000020:00000080:0.0:1787383456.773634:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383456.773652:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383456.773654:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.773655:0:17122:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383456.773657:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383456.773659:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383456.773661:0:17122:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787383456.773664:0:17122:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963620e92000 00000020:00000080:0.0:1787383456.773666:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787383456.773710:0:17122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17122:1874206984941568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383456.773979:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.774861:0:17122:0:(client.c:2702:ptlrpc_set_wait()) set ffff963628fa0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383456.776168:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984941568 00000100:00100000:2.0:1787383456.776179:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984941568 00000100:00100000:2.0:1787383456.776235:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383456.776244:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+11:17122:x1874206984941568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383456.777945:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+11:17122:x1874206984941568:12345-0@lo:502:llog_process_th.0 Request processed in 1695us (4029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383456.777958:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383456.778935:0:17122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17122:1874206984941568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787383456.778975:0:17122:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383456.779511:0:17122:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383456.779516:0:17122:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787383456.779522:0:17122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787383456.779723:0:17073:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787383456.780076:0:17073:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383456.780098:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f668 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383456.780110:0:17073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f668 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383456.780169:0:17073:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787383456.780172:0:17073:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff963620e92000 10000000:01000000:3.0:1787383456.780175:0:17073:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff963620e92000 10000000:01000000:3.0:1787383456.780178:0:17073:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787383456.780183:0:17073:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff963620e92000 from 1 10000000:01000000:3.0:1787383456.780186:0:17073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787383456.780219:0:17073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383456.780226:0:17073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383456.780246:0:17073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383456.780268:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984941696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787383456.780324:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383456.780356:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503723900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383456.780376:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984941696 00000100:00100000:3.0:1787383456.780382:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984941696 00000100:00100000:1.0:1787383456.782158:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787383456.782176:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+11:17073:x1874206984941696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383456.782194:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383456.782212:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96360516d200/0xc40acec91532f676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f66f expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.782238:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96360516d200/0xc40acec91532f676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f66f expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.782249:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96360516d200/0xc40acec91532f676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f66f expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.782259:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96360516d200, rc 0) 00000100:00100000:1.0:1787383456.782328:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17073:x1874206984941696:12345-0@lo:101:mount.lustre.0 Request processed in 159us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383456.782336:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787383456.784241:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984941696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383456.784266:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383456.784277:0:17073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383456.784419:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984941824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383456.784487:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383456.790867:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984941824 00000100:00100000:2.0:1787383456.790880:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984941824 00000100:00100000:2.0:1787383456.790941:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787383456.790950:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17073:x1874206984941824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383456.791288:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17073:x1874206984941824:12345-0@lo:501:mount.lustre.0 Request processed in 338us (6800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383456.791296:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787383456.795635:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503723900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383456.795676:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984941824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383456.796547:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984941952:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383456.796636:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.796714:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963628fa06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383456.804585:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984941952 00000100:00100000:3.0:1787383456.804600:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984941952 00000100:00100000:3.0:1787383456.804710:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787383456.804722:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17073:x1874206984941952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383456.805115:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17073:x1874206984941952:12345-0@lo:503:mount.lustre.0 Request processed in 394us (8478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383456.805124:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787383456.805232:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984941952:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383456.809682:0:17127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17127:1874206984942080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383456.809843:0:17127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383456.809878:0:17127:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146780 going to sleep for 11 seconds 00000100:00100000:3.0:1787383456.810219:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984942080 00000100:00100000:3.0:1787383456.810227:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984942080 00000100:00100000:3.0:1787383456.810283:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787383456.810293:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17127:x1874206984942080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383456.810420:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17127:x1874206984942080:12345-0@lo:502:llog_process_th.0 Request processed in 128us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383456.810429:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787383456.811188:0:17127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17127:1874206984942080:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787383456.811247:0:17127:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787383456.811261:0:17127:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9635033c3380) 00000020:00000080:2.0:1787383456.811280:0:17127:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1787383456.811529:0:17127:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963620e92000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787383456.811534:0:17127:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963620e92000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787383456.811537:0:17127:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963620e92000 4 00010000:00080000:2.0:1787383456.811563:0:17127:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96363db9f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1787383456.818590:0:17127:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1787383456.818699:0:17127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787383456.819104:0:17127:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787383456.819117:0:17127:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc40acec91532f684 00000100:00080000:2.0:1787383456.819127:0:17127:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383456.819133:0:17127:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96363db9f800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383456.819166:0:17127:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362d918e00 x1874206984942208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383456.819230:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984942208:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787383456.819291:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787383456.819347:0:17127:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787383456.827907:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984942208 00000100:00100000:1.0:1787383456.827922:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984942208 00000100:00100000:1.0:1787383456.827961:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383456.827969:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984942208:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787383456.830143:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984942208:12345-0@lo:38:llog_process_th.0 Request processed in 2167us (10843us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787383456.830157:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383456.832127:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787383456.832142:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363db9f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383456.832148:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787383456.832153:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984942208:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787383456.833076:0:17127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17127:1874206984942336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383456.833150:0:17127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.833189:0:17127:0:(client.c:2702:ptlrpc_set_wait()) set ffff963628fa06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383456.833232:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984942336 00000100:00100000:3.0:1787383456.833241:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984942336 00000100:00100000:3.0:1787383456.833281:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787383456.833287:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17127:x1874206984942336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383456.833414:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17127:x1874206984942336:12345-0@lo:502:llog_process_th.0 Request processed in 126us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383456.833422:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787383456.835563:0:17127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17127:1874206984942336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383456.835634:0:17127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17127:1874206984942464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383456.835697:0:17127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383456.835723:0:17127:0:(client.c:2702:ptlrpc_set_wait()) set ffff963628fa06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383456.835927:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984942464 00000100:00100000:2.0:1787383456.835933:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984942464 00000100:00100000:2.0:1787383456.836099:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787383456.836125:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17127:x1874206984942464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383456.836394:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17127:x1874206984942464:12345-0@lo:502:llog_process_th.0 Request processed in 274us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383456.836403:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787383456.840697:0:17127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:98408fb2-7fed-492b-911f-46eabbf1f8e3:17127:1874206984942464:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787383456.840870:0:17127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787383456.842255:0:17073:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787383456.842296:0:17073:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787383456.842324:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383456.842336:0:17073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787383456.842423:0:17073:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787383456.842426:0:17073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787383456.842427:0:17073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383456.842429:0:17073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383456.842430:0:17073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383456.842431:0:17073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383456.842432:0:17073:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787383456.842433:0:17073:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787383456.842435:0:17073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383456.842436:0:17073:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787383456.842440:0:17073:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787383456.842447:0:17073:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787383456.842449:0:17073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787383456.842449:0:17073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383456.842450:0:17073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383456.842451:0:17073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383456.842452:0:17073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383456.842453:0:17073:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787383456.842454:0:17073:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787383456.842455:0:17073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383456.842455:0:17073:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787383456.842479:0:17073:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787383456.842498:0:17073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984942592:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787383456.842561:0:17073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383456.842593:0:17073:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503723300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383456.842639:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984942592 00000100:00100000:3.0:1787383456.842645:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984942592 00000100:00100000:3.0:1787383456.842686:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787383456.842694:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17073:x1874206984942592:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787383456.842719:0:17086:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787383456.844427:0:17086:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787383456.847472:0:17086:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787383456.847492:0:17086:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787383456.847717:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17073:x1874206984942592:12345-0@lo:253:mount.lustre.0 Request processed in 5019us (5151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383456.847742:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:3.0:1787383456.847930:0:17110:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787383456.847936:0:17110:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787383456.847958:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383456.847975:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96360516c600/0xc40acec91532f65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f653 expref: 11 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383456.848053:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383456.848093:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96360516c600/0xc40acec91532f65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532f653 expref: 11 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383456.848119:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96360516c600/0xc40acec91532f65a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532f653 expref: 11 pid: 17088 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383456.848133:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984942720:0@lo:104: 00000100:00100000:3.0:1787383456.848171:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383456.848205:0:17110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636039189c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383456.848242:0:17073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f68e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17073:1874206984942592:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787383456.848254:0:17073:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787383456.848257:0:17073:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787383456.848259:0:17073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787383456.848261:0:17073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383456.848262:0:17073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383456.848263:0:17073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383456.848264:0:17073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383456.848266:0:17073:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787383456.848267:0:17073:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787383456.848268:0:17073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383456.848269:0:17073:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787383456.848283:0:17073:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787383456.849394:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984942720 00000100:00100000:2.0:1787383456.849403:0:17077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984942720 00000100:00100000:2.0:1787383456.849446:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383456.849455:0:17077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:17110:x1874206984942720:12345-0@lo:104: 00010000:00010000:2.0:1787383456.849469:0:17077:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f65a expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383456.849537:0:17077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787383456.849555:0:17077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:17110:x1874206984942720:12345-0@lo:104: Request processed in 101us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383456.849561:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383456.849598:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984942720:0@lo:104: 00010000:00010000:2.0:1787383456.849618:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.849899:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383456.849906:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f65a expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.849914:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383456.849918:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532f65a expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.849926:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532f65a expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383456.849933:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532f65a expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383456.849938:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383456.849969:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f65a expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.849974:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383456.850121:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f65a expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.850129:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963600031e00/0xc40acec91532f653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f65a expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.850146:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383456.850147:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383456.850149:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383456.850178:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984942848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383456.850219:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383456.850268:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984942848 00000100:00100000:1.0:1787383456.850272:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984942848 00010000:00010000:1.0:1787383456.850289:0:17079:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96360516c600/0xc40acec91532f65a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f653 expref: 12 pid: 17088 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383456.850308:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383456.850314:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:3648:x1874206984942848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383456.850324:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383456.850329:0:17079:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96360516c600/0xc40acec91532f65a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f653 expref: 12 pid: 17088 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.850338:0:17079:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96360516c600/0xc40acec91532f65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532f653 expref: 12 pid: 17088 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.850351:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96360516c600/0xc40acec91532f65a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532f653 expref: 12 pid: 17088 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.850362:0:17079:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.850369:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787383456.850381:0:17079:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002446584s 00010000:00010000:1.0:1787383456.850386:0:17079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.850392:0:17079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.850408:0:17079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.850415:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.850420:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383456.850424:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.850431:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.850442:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383456.850451:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383456.850479:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+11:3648:x1874206984942848:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383456.850486:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383456.850516:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984942848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383456.851098:0:17110:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383456.851109:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383456.851114:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963600030400/0xc40acec91532f68b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787383456.864665:0:17073:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787383456.865026:0:17073:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787383456.865147:0:17134:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787383456.865151:0:17134:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1787383456.865363:0:17135:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787383456.865461:0:17073:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1787383456.865894:0:17135:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1787383456.868089:0:17136:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff96362da08e00 x1874206984942976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383456.868104:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00000040:01000000:3.0:1787383456.868482:0:17073:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787383456.868519:0:17073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787383456.869120:0:17073:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787383456.869130:0:17073:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787383456.869179:0:17073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383456.870144:0:17135:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787383456.870214:0:17135:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1787383456.871170:0:17073:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787383456.872060:0:17073:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787383456.872105:0:17073:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787383456.874355:0:17073:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1787383456.876978:0:17073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787383456.879513:0:17073:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787383456.879557:0:17073:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb73d8144b988 00100000:10000000:2.0:1787383456.879565:0:17073:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787383456.881219:0:17073:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787383456.881236:0:17073:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787383456.881259:0:17073:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787383456.881285:0:17073:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787383456.881965:0:17073:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383456.882160:0:17073:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787383457.434941:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787383457.818996:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787383457.819001:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff963620e92000 from 7 10000000:01000000:3.0:1787383457.819005:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787383457.819067:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383457.819080:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383457.819090:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383457.819115:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984943104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383457.819175:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383457.819213:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e5300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383457.819235:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984943104 00000100:00100000:3.0:1787383457.819241:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984943104 00000100:00100000:3.0:1787383457.819283:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787383457.819290:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+11:17091:x1874206984943104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383457.819302:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383457.819314:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963600031000/0xc40acec91532f699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f692 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383457.819335:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963600031000/0xc40acec91532f699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f692 expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383457.819346:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963600031000/0xc40acec91532f699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f692 expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383457.819354:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600031000, rc 0) 00000100:00100000:3.0:1787383457.819392:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17091:x1874206984943104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383457.819399:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787383457.819453:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984943104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383457.819466:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f699 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383457.819474:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f699 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383457.819519:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984943232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787383457.819548:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383457.819560:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e5300 going to sleep for 11 seconds 00000040:00080000:2.0:1787383457.820094:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787383457.820156:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984943232 00000100:00100000:2.0:1787383457.820162:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984943232 00000100:00100000:2.0:1787383457.820200:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787383457.820208:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17091:x1874206984943232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787383457.820225:0:17088:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787383457.820240:0:17088:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787383457.820242:0:17088:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787383457.820326:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17091:x1874206984943232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383457.820334:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787383457.820349:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984943232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787383457.820395:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787383457.820401:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f699 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383457.820418:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f699 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383457.882882:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00010000:00010000:0.0:1787383458.459594:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787383458.843443:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787383458.907534:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00010000:00010000:3.0:1787383459.494272:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383459.938101:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00010000:00010000:0.0:1787383460.514156:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787383460.858216:0:17379:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787383460.957077:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00010000:00010000:0.0:1787383461.532842:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787383461.751023:0:17431:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787383461.751328:0:17431:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787383461.978823:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00000100:00100000:1.0:1787383462.045004:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984943360:0@lo:400:kworker.0 00000100:00100000:1.0:1787383462.045079:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383462.045305:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984943360 00000100:00100000:3.0:1787383462.045313:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984943360 00000100:00100000:3.0:1787383462.045359:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383462.045367:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:3649:x1874206984943360:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787383462.045425:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787383462.045429:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787383462.045433:0:8:0:(import.c:65:import_set_state_nolock()) ffff96363f98c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383462.045437:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 489 00000100:00080000:2.0:1787383462.045441:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787383462.045446:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96363f98c800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383462.045465:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362d91a680 x1874206984943488/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383462.045481:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383462.045485:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383462.045488:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383462.045491:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383462.045505:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787383462.045508:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787383462.045510:0:8:0:(import.c:65:import_set_state_nolock()) ffff96363db9f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383462.045514:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96363db9f800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383462.045524:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362d91bb80 x1874206984943616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383462.045548:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984943488:0@lo:38:kworker.0 00000100:00100000:2.0:1787383462.045591:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383462.045615:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984943616:0@lo:38:kworker.0 00000100:00100000:2.0:1787383462.045635:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383462.045666:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984943488 00000100:00100000:2.0:1787383462.045670:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984943488 00000100:00100000:2.0:1787383462.045687:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383462.045692:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984943488:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787383462.045707:0:17100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787383462.045894:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984943616 00000100:00100000:0.0:1787383462.045898:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984943616 00000100:00100000:0.0:1787383462.045916:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383462.045920:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1874206984943616:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787383462.045935:0:17096:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:0.0:1787383462.045964:0:17096:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc40acec91532f6a0 00000004:00100000:0.0:1787383462.045977:0:17096:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787383462.046102:0:17096:0:(import.c:65:import_set_state_nolock()) ffff963635dfb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383462.046140:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874206984943616:12345-0@lo:38:kworker.0 Request processed in 219us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383462.046147:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383462.047521:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:3649:x1874206984943360:12345-0@lo:400:kworker.0 Request processed in 2147us (2434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383462.047532:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787383462.047555:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984943360:0@lo:400:kworker.0 00010000:00080000:3.0:1787383462.047633:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96362d91bb80 x1874206984943616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787383462.047647:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787383462.047656:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787383462.047661:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787383462.047664:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363db9f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787383462.047682:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984943616:0@lo:38:kworker.0 00000100:00100000:2.0:1787383462.059868:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984943488:12345-0@lo:38:kworker.0 Request processed in 14167us (14268us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787383462.059883:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787383462.063340:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363f98c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383462.063351:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787383462.063357:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984943488:0@lo:38:kworker.0 00000020:00000004:2.0:1787383462.535078:0:17481:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383462.535278:0:17481:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787383462.566346:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383463.002836:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00010000:00010000:0.0:1787383463.584370:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383464.027316:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00010000:00010000:3.0:1787383464.604593:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383465.051744:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00010000:00010000:2.0:1787383465.627789:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383466.080478:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00000100:00100000:1.0:1787383466.141890:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383456/real 1787383456] req@ffff963503f68380 x1874206984940544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383466 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383466.141946:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503f68380 x1874206984940544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383466 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383466.141958:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383456/real 1787383456] req@ffff963503f21f80 x1874206984940416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383466 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383466.141969:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503f21f80 x1874206984940416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383466 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787383466.141999:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963635dfd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383466.142023:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787383466.142028:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984940544:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787383466.142035:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363d874000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383466.142040:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787383466.142044:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984940416:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787383466.142247:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787383466.142252:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787383466.142255:0:8:0:(import.c:65:import_set_state_nolock()) ffff96363f98c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383466.142261:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:0.0:1787383466.142267:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787383466.142275:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96363f98c800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383466.142303:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f21c00 x1874206984943872/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383466.142326:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383466.142329:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787383466.142331:0:8:0:(import.c:65:import_set_state_nolock()) ffff96363d874000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383466.142334:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 489 00000100:00080000:0.0:1787383466.142337:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787383466.142341:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96363d874000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383466.142355:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f22680 x1874206984944000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383466.142364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383466.142367:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787383466.142368:0:8:0:(import.c:65:import_set_state_nolock()) ffff963635dfd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383466.142371:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 489 00000100:00080000:0.0:1787383466.142374:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787383466.142378:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff963635dfd800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383466.142389:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f22d80 x1874206984944128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383466.142436:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984944256:0@lo:400:kworker.0 00000100:00100000:0.0:1787383466.142517:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383466.142598:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984943872:0@lo:38:kworker.0 00000100:00100000:0.0:1787383466.142634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383466.142660:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984944000:0@lo:8:kworker.0 00000400:00000100:0.0:1787383466.142694:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206984944000 offset 0 length 520: 4 00000100:00100000:0.0:1787383466.142712:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984944128:0@lo:8:kworker.0 00000400:00000100:0.0:1787383466.142974:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206984944128 offset 0 length 520: 4 00000100:00100000:0.0:1787383466.143073:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984943872 00000100:00100000:0.0:1787383466.143084:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984943872 00000100:00100000:0.0:1787383466.143143:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383466.143152:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206984943872:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787383466.143172:0:17099:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787383466.145840:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984943744:0@lo:400:kworker.0 00000100:00100000:1.0:1787383466.146065:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383466.146103:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984944256 00000100:00100000:2.0:1787383466.146115:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984944256 00000100:00100000:1.0:1787383466.146146:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984943744 00000100:00100000:1.0:1787383466.146151:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984943744 00000100:00100000:1.0:1787383466.146208:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383466.146219:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:3650:x1874206984943744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383466.146290:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:3650:x1874206984943744:12345-0@lo:400:kworker.0 Request processed in 72us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383466.146299:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383466.146363:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984943744:0@lo:400:kworker.0 00000100:00100000:1.0:1787383466.148801:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383466.148831:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984944256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383466.148965:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984944256:12345-0@lo:400:kworker.0 Request processed in 149us (6447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383466.148974:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787383466.149223:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff963503f21880 x1874206984944256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383466.149243:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984944256:0@lo:400:kworker.0 00000100:00100000:0.0:1787383466.174293:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206984943872:12345-0@lo:38:kworker.0 Request processed in 31133us (31649us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787383466.174308:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787383466.175161:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363f98c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383466.175174:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787383466.175189:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984943872:0@lo:38:kworker.0 00010000:00010000:2.0:1787383466.652916:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383467.099216:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00010000:00010000:0.0:1787383467.677902:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787383468.059744:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787383468.131093:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00010000:00010000:2.0:1787383468.699939:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787383469.065426:0:17826:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787383469.065431:0:17826:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787383469.065433:0:17826:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787383469.065557:0:17826:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff963636f5c800 00000020:01000004:1.0:1787383469.065573:0:17826:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1787383469.065585:0:17826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787383469.065598:0:17826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9636352ccd40) 00000020:00000080:1.0:1787383469.065614:0:17826:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00000100:00100000:2.0:1787383469.149219:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00100000:10000000:2.0:1787383469.192073:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787383469.194472:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787383469.208049:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787383469.208592:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787383469.208884:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787383469.209128:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1787383469.209392:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787383469.209599:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787383469.210000:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1787383469.210347:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787383469.212391:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1787383469.214921:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787383469.215354:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787383469.216213:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787383469.227738:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787383469.228398:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787383469.228617:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787383469.228932:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787383469.229608:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787383469.229933:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1787383469.230294:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787383469.231408:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1787383469.233447:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787383469.236535:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787383469.238241:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787383469.238620:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787383469.239535:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787383469.240136:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1787383469.240896:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787383469.241281:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787383469.242130:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787383469.242537:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787383469.242924:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787383469.244375:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787383469.245445:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787383469.245892:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787383469.246471:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787383469.251896:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787383469.253079:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1787383469.254280:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1787383469.254500:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787383469.255003:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787383469.255982:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1787383469.257091:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787383469.257369:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1787383469.257555:0:17826:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00080000:01000000:0.0:1787383469.261300:0:17826:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787383469.261512:0:17826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787383469.261525:0:17826:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787383469.261538:0:17826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532f6ae 00000020:01000004:0.0:1787383469.261545:0:17826:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787383469.261570:0:17826:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787383469.261573:0:17826:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787383469.261592:0:17826:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787383469.261621:0:17826:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787383469.261625:0:17826:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787383469.277312:0:17826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787383469.277372:0:17826:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.102@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787383469.277377:0:17826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787383469.277379:0:17826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787383469.277380:0:17826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383469.277381:0:17826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383469.277383:0:17826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383469.277384:0:17826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383469.277385:0:17826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383469.277387:0:17826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383469.277388:0:17826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787383469.277393:0:17826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787383469.277395:0:17826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787383469.277396:0:17826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787383469.277398:0:17826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383469.277399:0:17826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383469.277400:0:17826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383469.277401:0:17826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383469.277402:0:17826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383469.277404:0:17826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383469.277405:0:17826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787383469.277448:0:17826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787383469.277471:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984944384:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787383469.277547:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383469.277607:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383469.278643:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984944384 00000100:00100000:1.0:1787383469.278665:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984944384 00000100:00100000:1.0:1787383469.278731:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787383469.278741:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17826:x1874206984944384:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787383469.279109:0:17086:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787383469.279113:0:17086:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1787383469.279120:0:17086:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787383469.279517:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17826:x1874206984944384:12345-0@lo:253:mount.lustre.0 Request processed in 776us (1967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383469.279527:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787383469.284813:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984944384:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787383469.284834:0:17826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787383469.284838:0:17826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787383469.284840:0:17826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787383469.284841:0:17826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383469.284843:0:17826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383469.284844:0:17826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383469.284845:0:17826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383469.284846:0:17826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787383469.284848:0:17826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383469.284849:0:17826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787383469.286110:0:17826:0:(tgt_mount.c:101:server_register_mount()) register mount ffff963636f5c800 from lustre-MDT0001 10000000:01000000:1.0:1787383469.286150:0:17826:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1787383469.286153:0:17826:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1787383469.286161:0:17826:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9636352cb380 local copy 00010000:00010000:1.0:1787383469.286171:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383469.286293:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984944512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383469.286360:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383469.286446:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618fa4840 going to sleep for 11 seconds 00000100:00100000:0.0:1787383469.286486:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984944512 00000100:00100000:0.0:1787383469.286492:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984944512 00000100:00100000:0.0:1787383469.286564:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787383469.286572:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17826:x1874206984944512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383469.286656:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17826:x1874206984944512:12345-0@lo:501:mount.lustre.0 Request processed in 84us (295us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787383469.286663:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787383469.286751:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984944512:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787383469.286786:0:17826:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787383469.286804:0:17826:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787383469.286810:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.286818:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383469.286842:0:17826:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff963636f5c800 10000000:01000000:2.0:1787383469.286853:0:17826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787383469.286858:0:17826:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9636352cb380 10000000:01000000:2.0:1787383469.286860:0:17826:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787383469.286863:0:17826:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9636352cb380 from 1 10000000:01000000:2.0:1787383469.286866:0:17826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787383469.286889:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8600/0xc40acec91532f6b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.286897:0:17826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c8600/0xc40acec91532f6b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.286906:0:17826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c8600/0xc40acec91532f6b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383469.286918:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984944640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787383469.286944:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383469.287191:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a73d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383469.287469:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984944640 00000100:00100000:1.0:1787383469.287479:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984944640 00000100:00100000:1.0:1787383469.287506:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383469.287512:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+12:17826:x1874206984944640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383469.287520:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383469.287533:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96360516de00/0xc40acec91532f6bc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f6b5 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383469.287554:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96360516de00/0xc40acec91532f6bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f6b5 expref: 13 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383469.287565:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96360516de00/0xc40acec91532f6bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f6b5 expref: 13 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383469.287581:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96360516de00, rc 0) 00000100:00100000:1.0:1787383469.287663:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+13:17826:x1874206984944640:12345-0@lo:101:mount.lustre.0 Request processed in 150us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383469.287670:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787383469.287892:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984944640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383469.287906:0:17826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c8600/0xc40acec91532f6b5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f6bc expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.287915:0:17826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c8600/0xc40acec91532f6b5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f6bc expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383469.287933:0:17826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787383469.287990:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8600/0xc40acec91532f6b5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f6bc expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.287998:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c8600/0xc40acec91532f6b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f6bc expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383469.288017:0:17826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff963636f5c800 10000000:01000000:2.0:1787383469.288022:0:17826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787383469.288026:0:17826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff963636f5c800 from 1 10000000:01000000:2.0:1787383469.288029:0:17826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787383469.288103:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.288111:0:17826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.288119:0:17826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383469.288135:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984944768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787383469.288165:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383469.288195:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a73d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383469.288401:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984944768 00000100:00100000:1.0:1787383469.288407:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984944768 00000100:00100000:1.0:1787383469.288443:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787383469.288450:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+13:17826:x1874206984944768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383469.288459:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383469.288468:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96360516d000/0xc40acec91532f6ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f6c3 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383469.288483:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96360516d000/0xc40acec91532f6ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f6c3 expref: 14 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383469.288492:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96360516d000/0xc40acec91532f6ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f6c3 expref: 14 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383469.288500:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96360516d000, rc 0) 00000100:00100000:1.0:1787383469.288530:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+14:17826:x1874206984944768:12345-0@lo:101:mount.lustre.0 Request processed in 80us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383469.288536:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787383469.288609:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984944768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383469.288620:0:17826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.288627:0:17826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383469.288637:0:17826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787383469.288797:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.288805:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383469.288821:0:17826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787383469.288824:0:17826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787383469.288829:0:17826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff963636f5c800 10000000:01000000:2.0:1787383469.288832:0:17826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787383469.288834:0:17826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787383469.288836:0:17826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787383469.288851:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.288858:0:17826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.288865:0:17826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383469.288876:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984944896:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787383469.288901:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383469.288917:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a73d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383469.288990:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984944896 00000100:00100000:1.0:1787383469.288994:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984944896 00000100:00100000:1.0:1787383469.289027:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383469.289035:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+14:17826:x1874206984944896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383469.289052:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383469.289068:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96360516da00/0xc40acec91532f6d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f6d1 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383469.289081:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96360516da00/0xc40acec91532f6d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f6d1 expref: 15 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383469.289089:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96360516da00/0xc40acec91532f6d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f6d1 expref: 15 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383469.289096:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96360516da00, rc 0) 00000100:00100000:1.0:1787383469.289123:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+15:17826:x1874206984944896:12345-0@lo:101:mount.lustre.0 Request processed in 89us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383469.289129:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787383469.289258:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984944896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383469.289269:0:17826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.289275:0:17826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383469.293155:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1787383469.295109:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383469.301039:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787383469.301109:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787383469.301126:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787383469.301140:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787383469.301217:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1787383469.301235:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1787383469.301248:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1787383469.301262:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1787383469.301277:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1787383469.301289:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1787383469.301300:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1787383469.301311:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1787383469.301325:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1787383469.301339:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1787383469.301352:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1787383469.301363:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1787383469.301374:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1787383469.301388:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1787383469.301403:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1787383469.301415:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1787383469.301428:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1787383469.301442:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1787383469.301456:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1787383469.301485:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1787383469.301492:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1787383469.301591:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984945024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383469.301657:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383469.301706:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a73f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383469.301742:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984945024 00000100:00100000:3.0:1787383469.301758:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984945024 00000100:00100000:3.0:1787383469.301832:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787383469.301841:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+15:17826:x1874206984945024:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383469.302024:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+15:17826:x1874206984945024:12345-0@lo:501:mount.lustre.0 Request processed in 183us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383469.302032:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787383469.302363:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984945024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383469.302403:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984945152:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383469.302446:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383469.302475:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383469.302535:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984945152 00000100:00100000:3.0:1787383469.302540:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984945152 00000100:00100000:3.0:1787383469.302575:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787383469.302582:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+15:17826:x1874206984945152:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383469.303620:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+15:17826:x1874206984945152:12345-0@lo:503:mount.lustre.0 Request processed in 1034us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383469.303631:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787383469.303819:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984945152:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787383469.305473:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787383469.307378:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984945280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383469.310300:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383469.310354:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618fa4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383469.310420:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984945280 00000100:00100000:0.0:1787383469.310429:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984945280 00000100:00100000:0.0:1787383469.310486:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787383469.310576:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+15:17826:x1874206984945280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383469.312486:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+15:17826:x1874206984945280:12345-0@lo:502:mount.lustre.0 Request processed in 1904us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383469.312499:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787383469.312627:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984945280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383469.313471:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787383469.313507:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1787383469.313520:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1787383469.313531:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1787383469.313544:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1787383469.313556:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1787383469.313569:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1787383469.313580:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1787383469.313592:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1787383469.313604:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1787383469.313616:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1787383469.313628:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1787383469.313652:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1787383469.313664:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1787383469.313675:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1787383469.313688:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1787383469.313700:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1787383469.313712:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1787383469.313725:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1787383469.313741:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1787383469.313752:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1787383469.314037:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1787383469.314060:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1787383469.314075:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1787383469.314087:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1787383469.314098:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1787383469.314109:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1787383469.314124:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1787383469.314139:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1787383469.314167:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1787383469.314183:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1787383469.314195:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1787383469.314208:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1787383469.314225:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1787383469.314241:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1787383469.314254:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1787383469.314270:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1787383469.314283:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1787383469.314298:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1787383469.314313:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1787383469.314326:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1787383469.314340:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1787383469.314352:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1787383469.314364:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1787383469.314409:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984945408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383469.314485:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383469.314531:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618fa4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383469.314816:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984945408 00000100:00100000:3.0:1787383469.314825:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984945408 00000100:00100000:3.0:1787383469.314872:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383469.314881:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+15:17826:x1874206984945408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383469.315207:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+15:17826:x1874206984945408:12345-0@lo:502:mount.lustre.0 Request processed in 326us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383469.315217:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787383469.315445:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984945408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383469.315508:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1787383469.315518:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1787383469.320846:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383469.320862:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383469.320864:0:17830:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787383469.320872:0:17830:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787383469.320875:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383469.320919:0:17830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9635033c0000) 00000020:00000080:2.0:1787383469.320942:0:17830:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1787383469.320949:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787383469.321045:0:17830:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787383469.321053:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532f6e6 00000020:00000080:2.0:1787383469.321307:0:17830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787383469.321312:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383469.321316:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383469.321318:0:17830:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787383469.321321:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383469.321324:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383469.321325:0:17830:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787383469.321329:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383469.321337:0:17830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff963627ae3380) 00000020:00000080:2.0:1787383469.321347:0:17830:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1787383469.321351:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787383469.321353:0:17830:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787383469.321356:0:17830:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787383469.321362:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787383469.321404:0:17830:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963636f5c800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787383469.321416:0:17830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff963627ae0000) 00000020:00000080:2.0:1787383469.321424:0:17830:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1787383469.321487:0:17830:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787383469.321493:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532f6fb 00000020:00000080:2.0:1787383469.321581:0:17830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787383469.321587:0:17830:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787383469.321593:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc40acec91532f702 00080000:01000000:2.0:1787383469.321598:0:17830:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787383469.321602:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532f709 00010000:00010000:3.0:1787383469.381222:0:17830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1787383469.381730:0:17830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1787383469.382138:0:17830:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787383469.383151:0:17830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1787383469.383163:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383469.383169:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.383171:0:17830:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787383469.383174:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383469.383178:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.383180:0:17830:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787383469.383183:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787383469.383188:0:17830:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:00000080:0.0:1787383469.383213:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383469.383228:0:17830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9636345ab380) 00000020:00000080:0.0:1787383469.383246:0:17830:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1787383469.383251:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787383469.383314:0:17830:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787383469.383321:0:17830:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787383469.383327:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532f717 00010000:00080000:0.0:1787383469.383359:0:17830:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96363f937800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1787383469.385643:0:17830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1787383469.391602:0:17830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787383469.391617:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787383469.391654:0:17830:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787383469.391676:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532f71e 00000100:00080000:2.0:1787383469.391686:0:17830:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383469.391699:0:17830:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96363f937800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383469.391734:0:17830:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362d91b100 x1874206984945536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383469.391789:0:17830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787383469.392700:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984945536:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787383469.392821:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787383469.393238:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787383469.393243:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787383469.393247:0:36:0:(import.c:65:import_set_state_nolock()) ffff96363f98c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383469.393251:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:2.0:1787383469.393256:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787383469.393262:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96363f98c800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383469.393286:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362d91aa00 x1874206984945664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383469.393311:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383469.393316:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383469.393319:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383469.393322:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787383469.393370:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984945536 00000100:00100000:2.0:1787383469.393378:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984945536 00000100:00100000:2.0:1787383469.393411:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383469.393419:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984945536:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787383469.393443:0:17100:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000100:00100000:1.0:1787383469.393597:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984945792:0@lo:400:kworker.0 00000100:00100000:1.0:1787383469.393637:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383469.393701:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984945792 00000100:00100000:1.0:1787383469.393714:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984945792 00000100:00100000:1.0:1787383469.393747:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383469.393753:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984945792:12345-0@lo:400:kworker.0 00000020:00000080:2.0:1787383469.394240:0:17100:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532f725 00000004:00100000:2.0:1787383469.394256:0:17100:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787383469.394261:0:17100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000020:01000000:2.0:1787383469.394398:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383469.394406:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383469.394407:0:17830:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787383469.394411:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787383469.394414:0:17830:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787383469.394415:0:17830:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787383469.394416:0:17830:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787383469.394418:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787383469.394420:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383469.394421:0:17830:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787383469.394423:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383469.394428:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383469.394430:0:17830:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787383469.394433:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787383469.394489:0:17830:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787383469.394504:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383469.394507:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383469.394508:0:17830:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787383469.394511:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787383469.394512:0:17830:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1787383469.394513:0:17830:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787383469.394515:0:17830:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787383469.394516:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787383469.394519:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383469.394520:0:17830:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787383469.394522:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:1.0:1787383469.394610:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984945792:12345-0@lo:400:kworker.0 Request processed in 855us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383469.394619:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787383469.394679:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96362d919180 x1874206984945792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383469.394693:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984945792:0@lo:400:kworker.0 00000020:01000004:2.0:1787383469.395016:0:17830:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787383469.395023:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383469.395025:0:17830:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787383469.395031:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787383469.395035:0:17830:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:2.0:1787383469.395054:0:17830:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787383469.395058:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383469.395079:0:17830:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff963627ae4d40) 00000020:00000080:2.0:1787383469.395095:0:17830:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787383469.395100:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1787383469.395165:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984945664:0@lo:38:kworker.0 00000004:00080000:2.0:1787383469.395181:0:17830:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787383469.395189:0:17830:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787383469.395197:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532f733 00000100:00100000:3.0:1787383469.395229:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787383469.395231:0:17830:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96363505e800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1787383469.395439:0:17830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1787383469.395792:0:17099:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1787383469.395801:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00080000:3.0:1787383469.398991:0:17100:0:(import.c:65:import_set_state_nolock()) ffff963638b7a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383469.399088:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1874206984945536:12345-0@lo:38:llog_process_th.0 Request processed in 5664us (6272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383469.399103:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383469.399130:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984945664 00000100:00100000:3.0:1787383469.399137:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984945664 00000100:00100000:3.0:1787383469.399163:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383469.399170:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984945664:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787383469.399214:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984945664:12345-0@lo:38:kworker.0 Request processed in 42us (3986us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787383469.399219:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383469.399260:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787383469.399269:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363f98c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787383469.399273:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787383469.399277:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984945664:0@lo:38:kworker.0 00000100:00100000:3.0:1787383469.399287:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787383469.399292:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787383469.399299:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787383469.399304:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787383469.399307:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363f937800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787383469.399318:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984945536:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787383469.399387:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984945920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383469.399424:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383469.399456:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984945920 00000100:00100000:3.0:1787383469.399460:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984945920 00000100:00100000:3.0:1787383469.399491:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383469.399496:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1874206984945920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787383469.399522:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787383469.399569:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1874206984945920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383469.399576:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383469.399603:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984945920:0@lo:41:osp-pre-0-1.0 00000040:01000000:0.0:1787383469.400576:0:17830:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787383469.400847:0:17830:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787383469.404760:0:17830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383469.405653:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787383469.406687:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1787383469.411281:0:17836:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787383469.411294:0:17836:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787383469.412561:0:17830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787383469.412583:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787383469.412643:0:17830:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787383469.412675:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532f73a 00000100:00080000:0.0:1787383469.412686:0:17830:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383469.412692:0:17830:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96363505e800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383469.412730:0:17830:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f21180 x1874206984946048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383469.412760:0:17830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1787383469.412881:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984946048:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1787383469.412899:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383469.412904:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.412907:0:17830:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787383469.412910:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787383469.412913:0:17830:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1787383469.412914:0:17830:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787383469.412916:0:17830:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787383469.412917:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787383469.412921:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.412922:0:17830:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787383469.412925:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787383469.412930:0:17830:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787383469.412934:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.412936:0:17830:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787383469.412939:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787383469.412943:0:17830:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000400:00000100:3.0:1787383469.412955:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206984946048 offset 0 length 520: 4 00000020:01000000:0.0:1787383469.412995:0:17830:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787383469.413000:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383469.413012:0:17830:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9636345acd40) 00000020:00000080:0.0:1787383469.413025:0:17830:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1787383469.413031:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787383469.413087:0:17830:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787383469.413093:0:17830:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787383469.413105:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532f748 00010000:00080000:0.0:1787383469.413138:0:17830:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9635036f7800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.102@tcp at head 00000100:00080000:2.0:1787383469.413176:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383469.413182:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383469.413185:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383469.413187:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787383469.413341:0:17830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787383469.413405:0:17830:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787383469.413417:0:17830:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787383469.415047:0:17830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383469.415314:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787383469.415441:0:17830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787383469.416194:0:17838:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787383469.416200:0:17838:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787383469.417376:0:17830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787383469.417386:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787383469.417422:0:17830:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787383469.417439:0:17830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532f74f 00000100:00080000:0.0:1787383469.417449:0:17830:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383469.417454:0:17830:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9635036f7800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383469.417586:0:17830:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f20e00 x1874206984946176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787383469.417634:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984946176:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787383469.417692:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206984946176 offset 0 length 520: 4 00000100:00080000:0.0:1787383469.417739:0:17830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787383469.417887:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383469.417903:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.417905:0:17830:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787383469.417909:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383469.417912:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.417913:0:17830:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787383469.417916:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787383469.417918:0:17830:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787383469.417920:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383469.417922:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.417923:0:17830:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787383469.417925:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383469.417927:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.417928:0:17830:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787383469.417931:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787383469.417971:0:17830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383469.417974:0:17830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.417975:0:17830:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787383469.417978:0:17830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1787383469.418028:0:17826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1787383469.418055:0:17826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787383469.418069:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.418079:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383469.418087:0:17826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff963636f5c800 from 1 10000000:01000000:0.0:1787383469.418090:0:17826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787383469.418111:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.418119:0:17826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.418130:0:17826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383469.418144:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984946304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383469.418178:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383469.418199:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636011ca540 going to sleep for 11 seconds 00000100:00100000:0.0:1787383469.418219:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984946304 00000100:00100000:0.0:1787383469.418224:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984946304 00000100:00100000:0.0:1787383469.418259:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787383469.418266:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+15:17826:x1874206984946304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383469.418285:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383469.418296:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963610f17200/0xc40acec91532f75d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f756 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.418317:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963610f17200/0xc40acec91532f75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f756 expref: 16 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.418326:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963610f17200/0xc40acec91532f75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f756 expref: 16 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.418335:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17200, rc 0) 00000100:00100000:0.0:1787383469.418364:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+16:17826:x1874206984946304:12345-0@lo:101:mount.lustre.0 Request processed in 98us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383469.418371:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787383469.418411:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984946304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383469.418422:0:17826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f75d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.418430:0:17826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f75d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787383469.418669:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383469.418674:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383469.418677:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383469.418680:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787383469.419301:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984946432:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787383469.419340:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383469.419365:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636011ca540 going to sleep for 11 seconds 00000100:00100000:2.0:1787383469.419565:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984946432 00000100:00100000:2.0:1787383469.419570:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984946432 00000100:00100000:2.0:1787383469.419605:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787383469.419611:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+16:17826:x1874206984946432:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787383469.419625:0:17088:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787383469.419643:0:17088:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787383469.419646:0:17088:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787383469.419728:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+16:17826:x1874206984946432:12345-0@lo:256:mount.lustre.0 Request processed in 116us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383469.419735:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787383469.419906:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984946432:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787383469.420504:0:17826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787383469.420519:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f75d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383469.420795:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f75d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383469.420806:0:17826:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff963636f5c800 from 1 10000000:01000000:3.0:1787383469.420808:0:17826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383469.420837:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383469.420857:0:17826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383469.420867:0:17826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383469.421291:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984946560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787383469.421343:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383469.421422:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605301480 going to sleep for 11 seconds 00000100:00100000:2.0:1787383469.421705:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984946560 00000100:00100000:2.0:1787383469.421713:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984946560 00000100:00100000:2.0:1787383469.421757:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787383469.421796:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+16:17826:x1874206984946560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383469.421808:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383469.421822:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c9e00/0xc40acec91532f76b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f764 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.421846:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9e00/0xc40acec91532f76b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f764 expref: 17 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.421855:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c9e00/0xc40acec91532f76b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f764 expref: 17 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.421864:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9e00, rc 0) 00000100:00100000:2.0:1787383469.421919:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17826:x1874206984946560:12345-0@lo:101:mount.lustre.0 Request processed in 154us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383469.421925:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787383469.421993:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984946560:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383469.422006:0:17826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f76b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.422015:0:17826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f76b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383469.422148:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787383469.422186:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984946688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383469.422215:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383469.422248:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a73600 going to sleep for 11 seconds 00000100:00100000:3.0:1787383469.422525:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984946688 00000100:00100000:3.0:1787383469.422530:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984946688 00000100:00100000:3.0:1787383469.422567:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787383469.422575:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17826:x1874206984946688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383469.422672:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17826:x1874206984946688:12345-0@lo:501:mount.lustre.0 Request processed in 98us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383469.422680:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787383469.422726:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984946688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383469.422752:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984946816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383469.422822:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383469.422838:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a73600 going to sleep for 11 seconds 00000100:00100000:0.0:1787383469.422904:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984946816 00000100:00100000:0.0:1787383469.422910:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984946816 00000100:00100000:0.0:1787383469.422982:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787383469.422990:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17826:x1874206984946816:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383469.423081:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17826:x1874206984946816:12345-0@lo:503:mount.lustre.0 Request processed in 92us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383469.423088:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787383469.423181:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984946816:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787383469.423535:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787383469.423604:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984946944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383469.423648:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383469.423717:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636053010c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383469.424926:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984946944 00000100:00100000:2.0:1787383469.424937:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984946944 00000100:00100000:2.0:1787383469.425198:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787383469.425206:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17826:x1874206984946944:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383469.425335:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17826:x1874206984946944:12345-0@lo:502:mount.lustre.0 Request processed in 130us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383469.425341:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787383469.425422:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984946944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383469.425645:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787383469.425677:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1787383469.425687:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1787383469.425694:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1787383469.425701:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1787383469.425708:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1787383469.425714:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1787383469.425721:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1787383469.425728:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787383469.425737:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1787383469.425743:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1787383469.425798:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383469.425842:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383469.425933:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636225ed000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383469.426125:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984947072 00000100:00100000:1.0:1787383469.426129:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984947072 00000100:00100000:2.0:1787383469.426194:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787383469.426202:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17826:x1874206984947072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383469.426291:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17826:x1874206984947072:12345-0@lo:502:mount.lustre.0 Request processed in 89us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383469.426299:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787383469.426322:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947072:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383469.426364:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1787383469.426372:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787383469.426759:0:17840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383469.426982:0:17840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.426985:0:17840:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787383469.426992:0:17840:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff963636f5c800 00000020:00000080:0.0:1787383469.426995:0:17840:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383469.427004:0:17840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383469.427007:0:17840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.427014:0:17840:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787383469.427018:0:17840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383469.427020:0:17840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.427022:0:17840:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787383469.427025:0:17840:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff963636f5c800 00000020:00000080:0.0:1787383469.427027:0:17840:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383469.427094:0:17840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383469.427098:0:17840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.427099:0:17840:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787383469.427101:0:17840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383469.427104:0:17840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.427105:0:17840:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383469.427108:0:17840:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963636f5c800 00000020:00000080:0.0:1787383469.427110:0:17840:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383469.427128:0:17840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383469.427131:0:17840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.427133:0:17840:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383469.427135:0:17840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383469.427137:0:17840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.427138:0:17840:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787383469.427142:0:17840:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963636f5c800 00000020:00000080:0.0:1787383469.427144:0:17840:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383469.427173:0:17840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383469.427176:0:17840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383469.427178:0:17840:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787383469.427181:0:17840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1787383469.427300:0:17826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787383469.427324:0:17826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787383469.427343:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f76b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383469.427355:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f76b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383469.427411:0:17826:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787383469.427414:0:17826:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff963636f5c800 10000000:01000000:1.0:1787383469.427418:0:17826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff963636f5c800 10000000:01000000:1.0:1787383469.427424:0:17826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787383469.427430:0:17826:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff963636f5c800 from 1 10000000:01000000:1.0:1787383469.427432:0:17826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787383469.427461:0:17826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383469.427469:0:17826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383469.427479:0:17826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383469.427497:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787383469.427546:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383469.427583:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383469.428970:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984947200 00000100:00100000:2.0:1787383469.428981:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984947200 00000100:00100000:2.0:1787383469.429038:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787383469.429047:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17826:x1874206984947200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383469.429063:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383469.429078:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c9400/0xc40acec91532f779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f772 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.429103:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9400/0xc40acec91532f779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f772 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.429124:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c9400/0xc40acec91532f779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f772 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.429133:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9400, rc 0) 00000100:00100000:2.0:1787383469.429188:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17826:x1874206984947200:12345-0@lo:101:mount.lustre.0 Request processed in 141us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383469.429195:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787383469.429315:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383469.429333:0:17826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383469.429342:0:17826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787383469.436606:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787383469.437059:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383469.437324:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787383469.437354:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1787383469.437374:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1787383469.437405:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1787383469.437422:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1787383469.437441:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1787383469.437457:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1787383469.437471:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1787383469.437486:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1787383469.437499:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1787383469.437513:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1787383469.437528:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1787383469.437544:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1787383469.437561:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1787383469.437578:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1787383469.437593:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1787383469.437608:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1787383469.437623:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1787383469.437636:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1787383469.437650:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1787383469.437663:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1787383469.437690:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1787383469.437705:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1787383469.437718:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1787383469.437730:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1787383469.437741:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1787383469.437754:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1787383469.439618:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1787383469.439679:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1787383469.439688:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787383469.440003:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383469.440069:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383469.440109:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984947328 00000100:00100000:3.0:1787383469.440112:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636053013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383469.440116:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984947328 00000100:00100000:2.0:1787383469.440166:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787383469.440176:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17826:x1874206984947328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383469.440352:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17826:x1874206984947328:12345-0@lo:501:mount.lustre.0 Request processed in 176us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383469.440359:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787383469.440383:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383469.440422:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383469.440459:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383469.440530:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636053013c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383469.440565:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984947456 00000100:00100000:1.0:1787383469.440569:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984947456 00000100:00100000:1.0:1787383469.440631:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787383469.440646:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17826:x1874206984947456:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383469.440729:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17826:x1874206984947456:12345-0@lo:503:mount.lustre.0 Request processed in 85us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383469.440737:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787383469.441026:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787383469.441431:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787383469.441495:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383469.441540:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383469.441570:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984947584 00000100:00100000:3.0:1787383469.441573:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636053013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383469.441575:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984947584 00000100:00100000:2.0:1787383469.441671:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787383469.441680:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17826:x1874206984947584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383469.441809:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17826:x1874206984947584:12345-0@lo:502:mount.lustre.0 Request processed in 130us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383469.441817:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787383469.441973:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787383469.442154:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787383469.442182:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1787383469.442197:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1787383469.442213:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1787383469.442231:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1787383469.442263:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1787383469.442281:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1787383469.442296:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1787383469.442312:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1787383469.442328:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1787383469.442347:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1787383469.442363:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1787383469.442379:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1787383469.442395:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1787383469.442410:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1787383469.442426:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1787383469.442442:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1787383469.442457:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1787383469.442471:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1787383469.442493:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1787383469.442506:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1787383469.442531:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1787383469.442548:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1787383469.442566:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1787383469.442579:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1787383469.442591:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1787383469.442603:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1787383469.442616:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1787383469.442630:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1787383469.442644:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1787383469.442657:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1787383469.442675:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1787383469.442691:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1787383469.442706:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1787383469.442724:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1787383469.442741:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1787383469.442757:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1787383469.442998:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1787383469.443016:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1787383469.443032:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1787383469.443048:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1787383469.443064:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1787383469.443079:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1787383469.443097:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1787383469.443114:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1787383469.443132:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1787383469.443146:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1787383469.443162:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1787383469.443210:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383469.443273:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383469.443377:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636053013c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383469.443426:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984947712 00000100:00100000:1.0:1787383469.443432:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984947712 00000100:00100000:1.0:1787383469.443514:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383469.443523:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17826:x1874206984947712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383469.443626:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17826:x1874206984947712:12345-0@lo:502:mount.lustre.0 Request processed in 104us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383469.443635:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787383469.443711:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787383469.443927:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1787383469.443950:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1787383469.443981:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383469.444019:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383469.444045:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984947840 00000100:00100000:3.0:1787383469.444048:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984947840 00000100:00100000:3.0:1787383469.444073:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787383469.444079:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17826:x1874206984947840:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383469.444166:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17826:x1874206984947840:12345-0@lo:502:mount.lustre.0 Request processed in 86us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383469.444173:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787383469.444214:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636053013c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383469.444229:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984947840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787383469.444264:0:17826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1787383469.444273:0:17826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787383469.452545:0:17845:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787383469.452567:0:17845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff96350273cd40) 00000020:00000080:3.0:1787383469.452593:0:17845:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787383469.452833:0:17845:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963636f5c800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787383469.452838:0:17845:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963636f5c800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787383469.452841:0:17845:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963636f5c800 3 00010000:00080000:3.0:1787383469.452875:0:17845:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963638ad9000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:3.0:1787383469.454881:0:17845:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787383469.455333:0:17845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787383469.455385:0:17845:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787383469.455401:0:17845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc40acec91532f787 00000100:00080000:3.0:1787383469.455412:0:17845:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787383469.455427:0:17845:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff963638ad9000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383469.455466:0:17845:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f69880 x1874206984947968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383469.455531:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984947968:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787383469.455668:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787383469.456864:0:17845:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787383469.456927:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984947968 00000100:00100000:2.0:1787383469.456936:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984947968 00000100:00080000:0.0:1787383469.457010:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383469.457017:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787383469.457020:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383469.457023:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787383469.457107:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787383469.457115:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984947968:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787383469.457143:0:17094:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:2.0:1787383469.457202:0:17094:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc40acec91532f78e 00000004:00100000:2.0:1787383469.457222:0:17094:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787383469.457263:0:17094:0:(import.c:65:import_set_state_nolock()) ffff96363f9b0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383469.457352:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874206984947968:12345-0@lo:38:llog_process_th.0 Request processed in 237us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383469.457361:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787383469.457533:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff963503f69880 x1874206984947968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383469.457562:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787383469.457571:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787383469.457578:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787383469.457583:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787383469.457586:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963638ad9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787383469.457592:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984947968:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787383469.464535:0:17845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1787383469.464715:0:17826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787383469.464748:0:17826:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787383469.464799:0:17826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383469.464813:0:17826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787383469.464865:0:17826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787383469.464868:0:17826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787383469.464869:0:17826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383469.464870:0:17826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383469.464872:0:17826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383469.464873:0:17826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383469.464874:0:17826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383469.464876:0:17826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383469.464877:0:17826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787383469.464881:0:17826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787383469.464883:0:17826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787383469.464884:0:17826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787383469.464885:0:17826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383469.464886:0:17826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383469.464887:0:17826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383469.464895:0:17826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383469.464896:0:17826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383469.464897:0:17826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383469.464898:0:17826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787383469.464936:0:17826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787383469.464957:0:17826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984948096:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787383469.465035:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383469.465077:0:17826:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383469.465101:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984948096 00000100:00100000:2.0:1787383469.465108:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984948096 00000100:00100000:2.0:1787383469.465152:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787383469.465161:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17826:x1874206984948096:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787383469.465197:0:17086:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787383469.465210:0:17086:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787383469.475988:0:17074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787383469.476169:0:17086:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787383469.476187:0:17086:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787383469.476361:0:17110:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787383469.476365:0:17110:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787383469.476390:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.476410:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963600031000/0xc40acec91532f699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f692 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.476417:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963610f17200/0xc40acec91532f75d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f756 expref: 18 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.476425:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.476461:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963610f17200/0xc40acec91532f75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532f756 expref: 18 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.476474:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff963610f17200/0xc40acec91532f75d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532f756 expref: 18 pid: 17086 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383469.476490:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984948224:0@lo:104: 00000100:00100000:0.0:1787383469.476578:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383469.476757:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963600031000/0xc40acec91532f699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532f692 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.476784:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff963600031000/0xc40acec91532f699 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532f692 expref: 18 pid: 17089 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383469.476794:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984948352:0@lo:104: 00000100:00100000:0.0:1787383469.476818:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383469.476836:0:17110:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620ee1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787383469.477170:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984948224 00000100:00100000:0.0:1787383469.477178:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984948224 00000100:00100000:0.0:1787383469.477211:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984948352 00000100:00100000:0.0:1787383469.477214:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984948352 00000100:00100000:0.0:1787383469.477228:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383469.477236:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+4:17110:x1874206984948224:12345-0@lo:104: 00010000:00010000:0.0:1787383469.477318:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f75d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.477370:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787383469.477377:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+4:17110:x1874206984948224:12345-0@lo:104: Request processed in 141us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383469.477384:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383469.477403:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383469.477409:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:17110:x1874206984948352:12345-0@lo:104: 00010000:00010000:0.0:1787383469.477417:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f699 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.477448:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787383469.477459:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:17110:x1874206984948352:12345-0@lo:104: Request processed in 51us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383469.477465:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787383469.477483:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383469.477490:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f75d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.477497:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383469.477501:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532f75d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.477509:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532f75d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383469.477515:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532f75d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383469.477520:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787383469.477547:0:17082:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f75d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.477553:0:17082:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383469.477573:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f75d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.477579:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f756 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f75d expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.477590:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383469.477593:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f699 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.477623:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030c00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383469.477626:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532f699 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.477633:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532f699 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383469.477640:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532f699 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383469.477645:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787383469.477733:0:17082:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f699 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.477740:0:17082:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383469.477758:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f699 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.477783:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963600030c00/0xc40acec91532f692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f699 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.477797:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383469.477799:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383469.477800:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383469.477807:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383469.477826:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984948480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383469.477858:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383469.477891:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98408fb2-7fed-492b-911f-46eabbf1f8e3:3647:1874206984948608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383469.477924:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383469.477970:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984948480 00000100:00100000:0.0:1787383469.477975:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984948480 00010000:00010000:0.0:1787383469.477994:0:17079:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963610f17200/0xc40acec91532f75d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f756 expref: 19 pid: 17086 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383469.478012:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984948608 00000100:00100000:0.0:1787383469.478014:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984948608 00010000:00010000:0.0:1787383469.478022:0:17079:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963600031000/0xc40acec91532f699 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f692 expref: 20 pid: 17089 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383469.478031:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383469.478036:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:3650:x1874206984948480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383469.478056:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383469.478061:0:17079:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963610f17200/0xc40acec91532f75d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f756 expref: 20 pid: 17086 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.478070:0:17079:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963610f17200/0xc40acec91532f75d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532f756 expref: 20 pid: 17086 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.478083:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383469.478107:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:3650:x1874206984948480:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383469.478113:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383469.478125:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383469.478130:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:3647:x1874206984948608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383469.478136:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383469.478139:0:17079:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963600031000/0xc40acec91532f699 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f692 expref: 19 pid: 17089 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.478156:0:17079:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963600031000/0xc40acec91532f699 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532f692 expref: 19 pid: 17089 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.478167:0:17079:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.478174:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787383469.478186:0:17079:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002446584s 00010000:00010000:0.0:1787383469.478190:0:17079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.478196:0:17079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.478202:0:17079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.478208:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.478213:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383469.478217:0:17079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.478224:0:17079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.478231:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383469.479190:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383469.479234:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:3647:x1874206984948608:12345-0@lo:103:ldlm_bl.0 Request processed in 1102us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383469.479242:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383469.480564:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98408fb2-7fed-492b-911f-46eabbf1f8e3:3647:1874206984948608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383469.480611:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984948480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383469.483935:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963610f17200/0xc40acec91532f75d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532f756 expref: 18 pid: 17086 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383469.483952:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984948224:0@lo:104: 00010000:00010000:3.0:1787383469.483977:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963600031000/0xc40acec91532f699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532f692 expref: 17 pid: 17089 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383469.483987:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984948352:0@lo:104: 00010000:00010000:3.0:1787383469.484012:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383469.484023:0:17110:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383469.484030:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383469.484037:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963610f17400/0xc40acec91532f795 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383469.484543:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+16:17826:x1874206984948096:12345-0@lo:253:mount.lustre.0 Request processed in 19379us (19504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383469.484555:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787383469.484745:0:17826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:17826:1874206984948096:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787383469.484758:0:17826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787383469.484761:0:17826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787383469.485345:0:17826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787383469.485347:0:17826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383469.485348:0:17826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383469.485349:0:17826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383469.485351:0:17826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383469.485352:0:17826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787383469.485354:0:17826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383469.485355:0:17826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787383469.485368:0:17826:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1787383469.495551:0:17826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1787383469.496402:0:17851:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787383469.496413:0:17851:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787383469.496633:0:17852:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787383469.497041:0:17852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787383469.497113:0:17826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787383469.497913:0:17853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17853:1874206984948736:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787383469.498125:0:17853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383469.498160:0:17853:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618fea480 going to sleep for 11 seconds 00000100:00100000:3.0:1787383469.498218:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984948736 00000100:00100000:3.0:1787383469.498225:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984948736 00000100:00100000:3.0:1787383469.498273:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383469.498282:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17853:x1874206984948736:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787383469.498362:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17853:x1874206984948736:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 80us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383469.498369:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383469.498410:0:17853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17853:1874206984948736:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1787383469.498437:0:17853:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787383469.498461:0:17853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17853:1874206984948864:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787383469.498491:0:17853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383469.498513:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984948864 00000100:00100000:3.0:1787383469.498516:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984948864 00000100:00100000:3.0:1787383469.498537:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383469.498543:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17853:x1874206984948864:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787383469.498630:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17853:x1874206984948864:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 86us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383469.498636:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383469.498652:0:17853:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605301840 going to sleep for 11 seconds 00000100:00100000:3.0:1787383469.498665:0:17853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17853:1874206984948864:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787383469.498710:0:17853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17853:1874206984948992:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787383469.498735:0:17853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383469.498758:0:17853:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636053013c0 going to sleep for 11 seconds 00000040:00080000:2.0:1787383469.498953:0:17852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787383469.499024:0:17852:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1787383469.499066:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984948992 00000100:00100000:2.0:1787383469.499071:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984948992 00000100:00100000:2.0:1787383469.499111:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383469.499119:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17853:x1874206984948992:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787383469.499178:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17853:x1874206984948992:12345-0@lo:900:lod0001_rec0000.0 Request processed in 59us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383469.499185:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1787383469.499212:0:17826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787383469.499263:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:1.0:1787383469.499385:0:17853:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff963503f6b480 x1874206984948992/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787383485 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383469.499397:0:17853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17853:1874206984948992:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787383469.499440:0:17853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17853:1874206984949120:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787383469.499467:0:17853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383469.499488:0:17853:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618feab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383469.499583:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984949120 00000100:00100000:2.0:1787383469.499588:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984949120 00000100:00100000:2.0:1787383469.499616:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383469.499622:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17853:x1874206984949120:12345-0@lo:1000:lod0001_rec0000.0 00000004:00000080:0.0:1787383469.499694:0:17826:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787383469.499702:0:17826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787383469.499735:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787383469.503496:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17853:x1874206984949120:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 3862us (4016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383469.503510:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787383469.503584:0:17853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17853:1874206984949120:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1787383469.503665:0:17853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383469.504920:0:17826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787383469.505594:0:17826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787383469.505633:0:17826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787383469.507957:0:17826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787383469.509157:0:17826:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:1.0:1787383469.509600:0:17853:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787383469.509678:0:17853:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787383469.509683:0:17853:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1787383469.512124:0:17826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787383469.528666:0:17826:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787383469.528706:0:17826:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb73d85563988 00100000:10000000:0.0:1787383469.528715:0:17826:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1787383469.529759:0:17826:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787383469.529821:0:17826:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787383469.529840:0:17826:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787383469.529855:0:17826:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787383469.530619:0:17826:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383469.530869:0:17826:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787383469.723674:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383470.171042:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00000040:00080000:3.0:1787383470.496742:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787383470.618897:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787383470.618907:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff963636f5c800 from 8 10000000:01000000:0.0:1787383470.618912:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787383470.618970:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383470.618983:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383470.618993:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383470.619019:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984949248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383470.619094:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383470.619258:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984949248 00000100:00100000:1.0:1787383470.619266:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984949248 00000100:00100000:1.0:1787383470.619307:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787383470.619315:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+16:17091:x1874206984949248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383470.619327:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383470.619342:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96360516d600/0xc40acec91532f7a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f79c expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383470.619365:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96360516d600/0xc40acec91532f7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f79c expref: 17 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383470.619375:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96360516d600/0xc40acec91532f7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f79c expref: 17 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383470.619384:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96360516d600, rc 0) 00000100:00100000:1.0:1787383470.619418:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17091:x1874206984949248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383470.619424:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787383470.619561:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383470.619584:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984949248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383470.619598:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7a3 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383470.619608:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f7a3 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383470.619671:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984949376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787383470.619701:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383470.619732:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383470.621831:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984949376 00000100:00100000:2.0:1787383470.621843:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984949376 00000100:00100000:2.0:1787383470.621921:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787383470.621930:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17091:x1874206984949376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787383470.621962:0:17089:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787383470.621988:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787383470.621991:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787383470.622128:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17091:x1874206984949376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 199us (2426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383470.622137:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787383470.625069:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984949376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787383470.625161:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787383470.625173:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7a3 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383470.625198:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7a3 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383470.625209:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787383470.625212:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff963620e92000 from 8 10000000:01000000:3.0:1787383470.625215:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787383470.625248:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383470.625255:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383470.625263:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383470.625282:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984949504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383470.625336:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383470.625380:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a733c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383470.625728:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984949504 00000100:00100000:0.0:1787383470.625735:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984949504 00000100:00100000:0.0:1787383470.625811:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787383470.625820:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17091:x1874206984949504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383470.625832:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383470.625846:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963610f16c00/0xc40acec91532f7b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f7aa expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383470.625869:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963610f16c00/0xc40acec91532f7b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f7aa expref: 18 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383470.625880:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963610f16c00/0xc40acec91532f7b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f7aa expref: 18 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383470.625888:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16c00, rc 0) 00000100:00100000:0.0:1787383470.625937:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17091:x1874206984949504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383470.625943:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787383470.626085:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984949504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383470.626097:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7b1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383470.626105:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f7b1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383470.626152:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984949632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787383470.626186:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383470.626222:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a733c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383470.626671:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984949632 00000100:00100000:0.0:1787383470.626677:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984949632 00000100:00100000:0.0:1787383470.626706:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383470.626714:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17091:x1874206984949632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787383470.626729:0:17088:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787383470.626748:0:17088:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787383470.626752:0:17088:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787383470.626862:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17091:x1874206984949632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383470.626875:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787383470.627063:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984949632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787383470.627106:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787383470.627113:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7b1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383470.627123:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7b1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383470.747553:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383471.203263:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00000040:00080000:2.0:1787383471.517317:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787383471.785817:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383472.222394:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00010000:00010000:1.0:1787383472.796906:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383473.244539:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00010000:00010000:0.0:1787383473.820043:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787383474.086597:0:18096:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787383474.269960:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 0 seconds 00010000:00010000:2.0:1787383474.844300:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383474.848347:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984949760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383474.848418:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383474.848518:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984949760 00000100:00100000:0.0:1787383474.848527:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984949760 00000100:00100000:0.0:1787383474.848571:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787383474.848579:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984949760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383474.848611:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00080000:2.0:1787383474.848700:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787383474.848712:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787383474.848715:0:36:0:(import.c:65:import_set_state_nolock()) ffff96363f98c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383474.848723:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96363f98c800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383474.848744:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362d919500 x1874206984950016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383474.848760:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383474.848806:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383474.848808:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383474.848812:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383474.848824:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383474.848827:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383474.848830:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383474.848832:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787383474.849931:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984949760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1337us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383474.849943:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787383474.849980:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984949888:0@lo:400:kworker.0 00000100:00100000:0.0:1787383474.850025:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383474.850062:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383474.850069:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984950144:0@lo:400:kworker.0 00000100:00100000:0.0:1787383474.850093:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383474.850129:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984950016:0@lo:38:kworker.0 00000100:00100000:0.0:1787383474.850153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383474.850184:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984950144 00000100:00100000:0.0:1787383474.850190:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984950144 00000100:00100000:0.0:1787383474.850225:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383474.850233:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984950144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383474.850277:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984950144:12345-0@lo:400:kworker.0 Request processed in 45us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383474.850284:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383474.850302:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984950016 00000100:00100000:0.0:1787383474.850306:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984950016 00000100:00100000:0.0:1787383474.850335:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787383474.850340:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984950016:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787383474.850364:0:17100:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:0.0:1787383474.850396:0:17100:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532f7b8 00000004:00100000:0.0:1787383474.850410:0:17100:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787383474.850415:0:17100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1787383474.850493:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984950272:0@lo:400:kworker.0 00000100:00100000:0.0:1787383474.850519:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787383474.850562:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96362d918700 x1874206984950144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383474.850575:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984950144:0@lo:400:kworker.0 00000100:00100000:3.0:1787383474.850675:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984949888 00000100:00100000:3.0:1787383474.850680:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984949888 00000100:00100000:3.0:1787383474.850715:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787383474.850721:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:3649:x1874206984949888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383474.850758:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:3649:x1874206984949888:12345-0@lo:400:kworker.0 Request processed in 37us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383474.850784:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383474.850975:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984949888:0@lo:400:kworker.0 00000100:00100000:1.0:1787383474.851068:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984949760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383474.851329:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984950272 00000100:00100000:2.0:1787383474.851333:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984950272 00000100:00100000:2.0:1787383474.851365:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383474.851372:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984950272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383474.851425:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984950272:12345-0@lo:400:kworker.0 Request processed in 53us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383474.851431:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787383474.851487:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96362d919880 x1874206984950272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383474.851498:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984950272:0@lo:400:kworker.0 00000100:00080000:2.0:1787383474.882164:0:17100:0:(import.c:65:import_set_state_nolock()) ffff9636313f1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383474.882268:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874206984950016:12345-0@lo:38:kworker.0 Request processed in 31925us (32111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383474.882279:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787383474.882346:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787383474.882357:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787383474.882362:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787383474.882366:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363f98c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787383474.882381:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000026464b5f): req@ffff96362da08e00 x1874206984942976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383474.882398:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984950016:0@lo:38:kworker.0 00000100:00100000:2.0:1787383474.882492:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383474.882521:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383474.882536:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984950400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383474.882558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383474.882588:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984942976 00000100:00100000:2.0:1787383474.882595:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984942976 00000100:00100000:2.0:1787383474.882623:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984950400 00000100:00100000:2.0:1787383474.882627:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984950400 00000100:00100000:2.0:1787383474.882642:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383474.882650:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17136:x1874206984942976:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787383474.882714:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17136:x1874206984942976:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 64us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383474.882721:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383474.882733:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383474.882739:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984950400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787383474.882757:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787383474.882811:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984950400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383474.882817:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383474.882858:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984950400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383474.882880:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17136:1874206984942976:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1787383474.882912:0:17136:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787383474.882953:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17136:1874206984950528:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787383474.882982:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383474.883002:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383474.883012:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984950528 00000100:00100000:2.0:1787383474.883675:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984950528 00000100:00100000:2.0:1787383474.883749:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383474.883757:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17136:x1874206984950528:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787383474.883891:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17136:x1874206984950528:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 134us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383474.883898:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383474.892481:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17136:1874206984950528:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787383474.892593:0:17136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17136:1874206984950656:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787383474.892655:0:17136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383474.892689:0:17136:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383474.892711:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984950656 00000100:00100000:2.0:1787383474.892716:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984950656 00000100:00100000:2.0:1787383474.892759:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383474.892800:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17136:x1874206984950656:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787383474.892873:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17136:x1874206984950656:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 106us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383474.892880:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383474.892931:0:17136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17136:1874206984950656:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1787383474.892977:0:17136:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383474.897688:0:17136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787383474.898591:0:17136:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1787383474.898598:0:17136:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1787383475.302050:0:18148:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787383475.302271:0:18148:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787383475.871007:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787383476.460019:0:18198:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787383476.460228:0:18198:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787383476.891990:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787383477.498605:0:18246:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc1220efe0 00000020:00000080:1.0:1787383477.498622:0:18246:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787383477.498628:0:18246:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787383477.498637:0:18246:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc12211270 20000000:00000080:1.0:1787383477.498644:0:18246:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff963604a8ac00 uarg=0000000000000000 20000000:01000000:1.0:1787383477.498686:0:18246:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787383477.498693:0:18246:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787383477.498698:0:18246:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787383477.499478:0:18247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787383477.499653:0:18246:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787383477.507361:0:18246:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787383477.507392:0:18246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383477.507411:0:18246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96360516cc00/0xc40acec91532f668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f661 expref: 17 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383477.507418:0:18246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c9e00/0xc40acec91532f76b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f764 expref: 17 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383477.507425:0:18246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383477.507465:0:18246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c9e00/0xc40acec91532f76b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532f764 expref: 17 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383477.507482:0:18246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636113c9e00/0xc40acec91532f76b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532f764 expref: 17 pid: 17089 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383477.507514:0:18246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18246:1874206984950784:0@lo:104: 00000100:00100000:1.0:1787383477.507576:0:18246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383477.507627:0:18246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96360516cc00/0xc40acec91532f668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532f661 expref: 17 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383477.507635:0:18246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96360516cc00/0xc40acec91532f668 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532f661 expref: 17 pid: 17086 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383477.507644:0:18246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18246:1874206984950912:0@lo:104: 00000100:00100000:1.0:1787383477.507665:0:18246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383477.507686:0:18246:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383477.507983:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984950784 00000100:00100000:0.0:1787383477.507992:0:17077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984950784 00000100:00100000:0.0:1787383477.508032:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984950912 00000100:00100000:0.0:1787383477.508035:0:17077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984950912 00000100:00100000:0.0:1787383477.508050:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383477.508059:0:17077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+4:18246:x1874206984950784:12345-0@lo:104: 00010000:00010000:0.0:1787383477.508072:0:17077:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f76b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508131:0:17077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787383477.508137:0:17077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+4:18246:x1874206984950784:12345-0@lo:104: Request processed in 80us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383477.508143:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383477.508169:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787383477.508175:0:17077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:18246:x1874206984950912:12345-0@lo:104: 00010000:00010000:0.0:1787383477.508183:0:17077:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f668 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508217:0:17077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787383477.508222:0:17077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:18246:x1874206984950912:12345-0@lo:104: Request processed in 48us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383477.508227:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787383477.508243:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383477.508248:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f76b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508255:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031200 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383477.508258:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532f76b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508266:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532f76b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383477.508273:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532f76b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383477.508279:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787383477.508307:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f76b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508313:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383477.508331:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f76b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508348:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963600031200/0xc40acec91532f764 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f76b expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508360:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383477.508363:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f668 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508369:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16000 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383477.508371:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532f668 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508378:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532f668 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383477.508384:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532f668 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383477.508388:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787383477.508412:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f668 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508418:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383477.508424:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f668 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508430:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963610f16000/0xc40acec91532f661 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f668 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508442:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383477.508449:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383477.508451:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383477.508471:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984951040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383477.508499:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383477.508526:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383477.508532:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984951168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383477.508551:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383477.508587:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984951040 00000100:00100000:0.0:1787383477.508590:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984951040 00010000:00010000:0.0:1787383477.508606:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c9e00/0xc40acec91532f76b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f764 expref: 18 pid: 17089 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383477.508624:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984951168 00000100:00100000:0.0:1787383477.508627:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984951168 00010000:00010000:0.0:1787383477.508637:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96360516cc00/0xc40acec91532f668 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f661 expref: 19 pid: 17086 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383477.508649:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383477.508655:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:3649:x1874206984951040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383477.508665:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383477.508670:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c9e00/0xc40acec91532f76b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f764 expref: 19 pid: 17089 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508679:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c9e00/0xc40acec91532f76b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532f764 expref: 19 pid: 17089 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508694:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383477.508721:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:3649:x1874206984951040:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383477.508727:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383477.508747:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787383477.508752:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:3649:x1874206984951168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383477.508760:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383477.508785:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96360516cc00/0xc40acec91532f668 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f661 expref: 18 pid: 17086 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508794:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96360516cc00/0xc40acec91532f668 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532f661 expref: 18 pid: 17086 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508806:0:17080:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508813:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508826:0:17080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508834:0:17080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508841:0:17080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508970:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508976:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96360516ce00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383477.508980:0:17080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.508987:0:17080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.509002:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383477.509011:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383477.509033:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:3649:x1874206984951168:12345-0@lo:103:ldlm_bl.0 Request processed in 280us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383477.509038:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787383477.509075:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984951168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383477.509082:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984951040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383477.509613:0:18246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9e00/0xc40acec91532f76b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532f764 expref: 17 pid: 17089 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383477.509626:0:18246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18246:1874206984950784:0@lo:104: 00010000:00010000:1.0:1787383477.509638:0:18246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96360516cc00/0xc40acec91532f668 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532f661 expref: 16 pid: 17086 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383477.509646:0:18246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18246:1874206984950912:0@lo:104: 00010000:00010000:1.0:1787383477.509661:0:18246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383477.509670:0:18246:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383477.509676:0:18246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383477.509695:0:18246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96360516ce00/0xc40acec91532f7bf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383477.511017:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383477.915256:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787383478.304413:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787383478.746869:0:17091:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787383478.746877:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff963636f5c800 from 13 10000000:01000000:0.0:1787383478.746883:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383478.746943:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383478.746954:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383478.746965:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383478.746994:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984951296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383478.747062:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383478.747102:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383478.747416:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984951296 00000100:00100000:1.0:1787383478.747426:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984951296 00000100:00100000:1.0:1787383478.747583:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787383478.747594:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+16:17091:x1874206984951296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383478.747608:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383478.747623:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96360516ce00/0xc40acec91532f7cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f7c6 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383478.747647:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96360516ce00/0xc40acec91532f7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f7c6 expref: 17 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383478.747659:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96360516ce00/0xc40acec91532f7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f7c6 expref: 17 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383478.747669:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96360516ce00, rc 0) 00000100:00100000:0.0:1787383478.748140:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984951296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383478.748159:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7cd expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383478.748180:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f7cd expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383478.748498:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17091:x1874206984951296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383478.748507:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787383478.748544:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984951424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383478.748584:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383478.748616:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383478.748789:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984951424 00000100:00100000:0.0:1787383478.748794:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984951424 00000100:00100000:0.0:1787383478.748828:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787383478.748834:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17091:x1874206984951424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383478.748957:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17091:x1874206984951424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383478.748964:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787383478.748999:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984951424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383478.749030:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984951552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383478.749073:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383478.749091:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383478.749101:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984951552 00000100:00100000:0.0:1787383478.749105:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984951552 00000100:00100000:0.0:1787383478.749121:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787383478.749126:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17091:x1874206984951552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383478.749200:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17091:x1874206984951552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383478.749207:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787383478.749360:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984951552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787383478.752465:0:18308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787383478.752631:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787383478.752654:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787383478.752665:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7cd expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383478.752676:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7cd expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383478.752698:0:17091:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787383478.752701:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff963620e92000 from 13 10000000:01000000:1.0:1787383478.752703:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787383478.752934:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383478.752944:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383478.752955:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383478.752980:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984951680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787383478.753044:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383478.753092:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383478.753139:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984951680 00000100:00100000:2.0:1787383478.753146:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984951680 00000100:00100000:2.0:1787383478.753196:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787383478.753205:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+17:17091:x1874206984951680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383478.753219:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383478.753233:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c9a00/0xc40acec91532f7db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f7d4 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383478.753253:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9a00/0xc40acec91532f7db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f7d4 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383478.753263:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c9a00/0xc40acec91532f7db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f7d4 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383478.753272:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9a00, rc 0) 00000100:00100000:2.0:1787383478.753315:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17091:x1874206984951680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383478.753321:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787383478.753419:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984951680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383478.753431:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7db expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383478.753438:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f7db expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383478.753493:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984951808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383478.753519:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383478.753574:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383478.754696:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984951808 00000100:00100000:3.0:1787383478.754864:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984951808 00000100:00100000:3.0:1787383478.755048:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787383478.755058:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17091:x1874206984951808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383478.758612:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17091:x1874206984951808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3547us (5083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383478.758626:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787383478.758727:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984951808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383478.758816:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984951936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383478.758872:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383478.758917:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383478.760419:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984951936 00000100:00100000:3.0:1787383478.760431:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984951936 00000100:00100000:3.0:1787383478.760492:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787383478.760503:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17091:x1874206984951936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383478.760655:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:17091:x1874206984951936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383478.760663:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787383478.760830:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984951936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787383478.763963:0:18309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787383478.764073:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787383478.764105:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787383478.764143:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7db expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383478.764156:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7db expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383478.941814:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383479.964295:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383469/real 1787383469] req@ffff963503f20e00 x1874206984946176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383479.964331:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503f20e00 x1874206984946176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383479.964341:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383469/real 1787383469] req@ffff963503f21180 x1874206984946048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383479.964351:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503f21180 x1874206984946048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787383479.964370:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9635036f7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1787383479.964478:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984952064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383479.964550:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383479.964611:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984952064 00000100:00100000:2.0:1787383479.964618:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984952064 00000100:00100000:2.0:1787383479.964666:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383479.964675:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984952064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787383479.964709:0:17835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787383479.964754:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984952064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383479.964761:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383479.964823:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984952064:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1787383479.965606:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383479.965612:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787383479.965615:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383479.965618:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787383479.965637:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383479.965640:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787383479.965642:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383479.965645:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787383479.965649:0:13975:0:(import.c:65:import_set_state_nolock()) ffff9635036f7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383479.965654:0:13975:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 502 00000100:00080000:0.0:1787383479.965658:0:13975:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787383479.965663:0:13975:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9635036f7800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383479.965686:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503fda680 x1874206984952704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383479.965727:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984952448:0@lo:400:kworker.0 00000100:00100000:0.0:1787383479.965827:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383479.965854:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383479.965859:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984952320:0@lo:400:kworker.0 00000100:00100000:0.0:1787383479.965896:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383479.965937:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984952448 00000100:00100000:0.0:1787383479.965943:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984952448 00000100:00100000:0.0:1787383479.965974:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787383479.965998:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984952448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383479.966039:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984952448:12345-0@lo:400:kworker.0 Request processed in 57us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383479.966046:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787383479.966078:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963503f22a00 x1874206984952448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383479.966090:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984952448:0@lo:400:kworker.0 00000100:00080000:1.0:1787383479.967351:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787383479.967360:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984946176:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787383479.967370:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363505e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383479.967375:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787383479.967378:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984946048:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787383479.967404:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984952704:0@lo:8:kworker.0 00000400:00000100:1.0:1787383479.967443:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206984952704 offset 0 length 520: 4 00000100:00080000:1.0:1787383479.967486:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383479.967491:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383479.967501:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383479.967504:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383479.967508:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383479.967511:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787383479.967513:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96363505e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787383479.967517:0:13975:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 502 00000100:00080000:1.0:1787383479.967521:0:13975:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787383479.967527:0:13975:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96363505e800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383479.967554:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362da08e00 x1874206984952960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383479.967599:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984952960:0@lo:8:kworker.0 00000400:00000100:1.0:1787383479.967623:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206984952960 offset 0 length 520: 4 00000100:00100000:2.0:1787383479.969312:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984952192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383479.969374:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383479.969404:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984952832:0@lo:400:kworker.0 00000100:00100000:2.0:1787383479.969429:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383479.969452:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383479.969457:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984952576:0@lo:400:kworker.0 00000100:00100000:2.0:1787383479.969476:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383479.969510:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984952320 00000100:00100000:2.0:1787383479.969519:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984952320 00000100:00100000:2.0:1787383479.969562:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787383479.969571:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:3650:x1874206984952320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383479.969703:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:3650:x1874206984952320:12345-0@lo:400:kworker.0 Request processed in 132us (3813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383479.969711:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787383479.969745:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984952832 00000100:00100000:2.0:1787383479.970671:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984952832 00000100:00100000:2.0:1787383479.970730:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787383479.970737:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984952832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383479.970950:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984952832:12345-0@lo:400:kworker.0 Request processed in 213us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383479.970957:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787383479.971082:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984952192 00000100:00100000:2.0:1787383479.971088:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984952192 00000100:00100000:2.0:1787383479.971108:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984952576 00000100:00100000:2.0:1787383479.971111:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984952576 00000100:00100000:2.0:1787383479.971121:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383479.971126:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1874206984952192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383479.971150:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787383479.971180:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1874206984952192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383479.971186:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383479.971331:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383479.971338:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984952576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383479.971365:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984952576:12345-0@lo:400:kworker.0 Request processed in 28us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383479.971370:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383479.971420:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984952320:0@lo:400:kworker.0 00000100:00100000:2.0:1787383479.971450:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984952576:0@lo:400:kworker.0 00000100:00100000:2.0:1787383479.971462:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984952192:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1787383479.971475:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963503fd9880 x1874206984952832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383479.971499:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984952832:0@lo:400:kworker.0 00010000:00010000:2.0:1787383479.971521:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383480.991249:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787383480.992703:0:17827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:1.0:1787383481.757117:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787383482.012606:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383482.012864:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383466/real 1787383466] req@ffff963503f22680 x1874206984944000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383481 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383482.012906:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503f22680 x1874206984944000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383481 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383482.012916:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383466/real 1787383466] req@ffff963503f22d80 x1874206984944128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383481 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383482.012928:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503f22d80 x1874206984944128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383481 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787383482.012951:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363d874000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383482.012974:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787383482.012989:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984944000:0@lo:8:kworker.0 00000100:00080000:0.0:1787383482.013224:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383482.013228:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787383482.013230:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96363d874000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383482.013235:0:13975:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:0.0:1787383482.013239:0:13975:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787383482.013246:0:13975:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96363d874000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383482.013264:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503fd9180 x1874206984953344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383482.013274:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383482.013284:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787383482.013308:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1787383482.013326:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984953216:0@lo:400:kworker.0 00000100:00100000:2.0:1787383482.013389:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383482.013430:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383482.013437:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984953088:0@lo:400:kworker.0 00000100:00100000:2.0:1787383482.013468:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787383482.013472:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787383482.013477:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383482.013480:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787383482.013503:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984953472:0@lo:400:kworker.0 00000100:00080000:0.0:1787383482.013518:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963635dfd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383482.013531:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787383482.013536:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383482.013540:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984944128:0@lo:8:kworker.0 00000100:00100000:2.0:1787383482.013563:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383482.013569:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984953344:0@lo:8:kworker.0 00000100:00100000:2.0:1787383482.013574:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984953600:0@lo:400:kworker.0 00000400:00000100:0.0:1787383482.013602:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206984953344 offset 0 length 520: 4 00000100:00100000:2.0:1787383482.013608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787383482.013635:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383482.013639:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787383482.013642:0:13975:0:(import.c:65:import_set_state_nolock()) ffff963635dfd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383482.013646:0:13975:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:0.0:1787383482.013649:0:13975:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1787383482.013652:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984953216 00000100:00080000:0.0:1787383482.013654:0:13975:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff963635dfd800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383482.013661:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984953216 00000100:00100000:2.0:1787383482.013706:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984953600 00000100:00100000:2.0:1787383482.013710:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984953600 00000100:00100000:1.0:1787383482.013714:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984953728:0@lo:400:kworker.0 00000100:00100000:2.0:1787383482.013730:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787383482.013733:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503fd9500 x1874206984953856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383482.013741:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984953216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787383482.013757:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383482.013761:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787383482.013784:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383482.013788:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787383482.013825:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984953216:12345-0@lo:400:kworker.0 Request processed in 88us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383482.013833:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787383482.013850:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787383482.013857:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984953600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383482.013868:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984953856:0@lo:8:kworker.0 00000400:00000100:0.0:1787383482.013907:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206984953856 offset 0 length 520: 4 00000100:00100000:2.0:1787383482.013914:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984953600:12345-0@lo:400:kworker.0 Request processed in 57us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383482.013931:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787383482.013956:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984953088 00000100:00100000:2.0:1787383482.013960:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984953088 00000100:00100000:2.0:1787383482.013991:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787383482.013999:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:3650:x1874206984953088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383482.014029:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383482.014032:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:3650:x1874206984953088:12345-0@lo:400:kworker.0 Request processed in 35us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383482.014039:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787383482.014063:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984953472 00000100:00100000:2.0:1787383482.014068:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984953728 00000100:00100000:0.0:1787383482.014069:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984953472 00000100:00100000:2.0:1787383482.014073:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984953728 00000100:00100000:2.0:1787383482.014111:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787383482.014118:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383482.014122:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984953728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383482.014132:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984953472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383482.014163:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984953728:12345-0@lo:400:kworker.0 Request processed in 44us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383482.014170:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787383482.014183:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984953472:12345-0@lo:400:kworker.0 Request processed in 54us (648us total) trans 0 rc 0/0 00010000:00080000:1.0:1787383482.014184:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963503fdaa00 x1874206984953728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383482.014201:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383482.014206:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984953600:0@lo:400:kworker.0 00000100:00100000:1.0:1787383482.014206:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984953728:0@lo:400:kworker.0 00010000:00080000:2.0:1787383482.014220:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963503fd9f80 x1874206984953472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383482.014228:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984953472:0@lo:400:kworker.0 00000100:00100000:2.0:1787383482.014251:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984953088:0@lo:400:kworker.0 00000100:00100000:2.0:1787383482.014261:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984953216:0@lo:400:kworker.0 00010000:00010000:3.0:1787383483.036250:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787383483.576904:0:18595:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787383483.576908:0:18595:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787383483.576910:0:18595:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787383483.577021:0:18595:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff963638ad9800 00000020:01000004:3.0:1787383483.577036:0:18595:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787383483.577048:0:18595:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787383483.577063:0:18595:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96350273b380) 00000020:00000080:3.0:1787383483.577078:0:18595:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787383483.617615:0:18595:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787383483.622422:0:18595:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787383483.622748:0:18595:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787383483.623452:0:18595:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787383483.623745:0:18595:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787383483.624113:0:18595:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787383483.624343:0:18595:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1787383483.632375:0:18595:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787383483.632687:0:18595:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787383483.632700:0:18595:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787383483.632713:0:18595:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc40acec91532f7e9 00000020:01000004:1.0:1787383483.632720:0:18595:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787383483.632740:0:18595:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787383483.632743:0:18595:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787383483.632749:0:18595:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787383483.632753:0:18595:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787383483.633050:0:18595:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9636352c99c0) 00000020:00000080:1.0:1787383483.633065:0:18595:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1787383483.634409:0:18595:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383483.634566:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787383483.634573:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787383483.639138:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787383483.639152:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787383483.642271:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787383483.642283:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787383483.646188:0:18595:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383483.646344:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787383483.646350:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787383483.647497:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787383483.647507:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787383483.680929:0:18595:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383483.681159:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787383483.681166:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787383483.683517:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787383483.683535:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787383483.685386:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787383483.685398:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787383483.688418:0:18595:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383483.688720:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787383483.688726:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787383483.689692:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787383483.689702:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787383483.750359:0:18595:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383483.751000:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787383483.751006:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787383483.752453:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787383483.752479:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787383483.753959:0:18595:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787383483.753991:0:18595:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787383483.753996:0:18595:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787383483.799008:0:18595:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787383483.799065:0:18595:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.102@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787383483.799070:0:18595:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787383483.799071:0:18595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787383483.799072:0:18595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383483.799073:0:18595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383483.799074:0:18595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383483.799076:0:18595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383483.799077:0:18595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383483.799079:0:18595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383483.799080:0:18595:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787383483.799083:0:18595:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787383483.799086:0:18595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787383483.799087:0:18595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787383483.799088:0:18595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383483.799089:0:18595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383483.799090:0:18595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383483.799091:0:18595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383483.799092:0:18595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383483.799093:0:18595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383483.799094:0:18595:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787383483.799133:0:18595:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787383483.799154:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984953984:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787383483.799226:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383483.799414:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984953984 00000100:00100000:2.0:1787383483.799422:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984953984 00000100:00100000:2.0:1787383483.799484:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787383483.799494:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:18595:x1874206984953984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787383483.799522:0:17088:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787383483.799526:0:17088:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787383483.799541:0:17088:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787383483.800125:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:18595:x1874206984953984:12345-0@lo:253:mount.lustre.0 Request processed in 629us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383483.800134:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787383483.800433:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620ee1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787383483.800609:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984953984:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787383483.800625:0:18595:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787383483.800640:0:18595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787383483.800642:0:18595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787383483.800643:0:18595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383483.800644:0:18595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383483.800645:0:18595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383483.800646:0:18595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383483.800648:0:18595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383483.800650:0:18595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383483.800651:0:18595:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787383483.800670:0:18595:0:(tgt_mount.c:101:server_register_mount()) register mount ffff963638ad9800 from lustre-OST0000 10000000:01000000:1.0:1787383483.800708:0:18595:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787383483.800711:0:18595:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787383483.800718:0:18595:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9636352cb380 local copy 00010000:00010000:1.0:1787383483.800729:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383483.802052:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383483.802106:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.802140:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a73180 going to sleep for 11 seconds 00000100:00100000:2.0:1787383483.803044:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984954112 00000100:00100000:2.0:1787383483.803054:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984954112 00000100:00100000:2.0:1787383483.803115:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787383483.803125:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:18595:x1874206984954112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383483.803250:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:18595:x1874206984954112:12345-0@lo:501:mount.lustre.0 Request processed in 126us (1142us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383483.803270:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787383483.804084:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954112:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787383483.804110:0:18595:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787383483.804145:0:18595:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787383483.804156:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383483.804167:0:18595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383483.804198:0:18595:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff963638ad9800 10000000:01000000:1.0:1787383483.804203:0:18595:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787383483.804209:0:18595:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787383483.804221:0:18595:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787383483.804227:0:18595:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787383483.804230:0:18595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787383483.804274:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383483.804283:0:18595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383483.804293:0:18595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383483.804314:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787383483.804649:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.804688:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a73180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383483.804745:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984954240 00000100:00100000:3.0:1787383483.804751:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984954240 00000100:00100000:3.0:1787383483.804831:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787383483.804840:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+18:18595:x1874206984954240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383483.804851:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383483.804874:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963600031000/0xc40acec91532f7fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f7f7 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383483.805141:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963600031000/0xc40acec91532f7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f7f7 expref: 19 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383483.805152:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963600031000/0xc40acec91532f7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f7f7 expref: 19 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383483.805161:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600031000, rc 0) 00000100:00100000:3.0:1787383483.805204:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:18595:x1874206984954240:12345-0@lo:101:mount.lustre.0 Request processed in 365us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383483.805210:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787383483.806430:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383483.806451:0:18595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383483.806462:0:18595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383483.808721:0:18595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787383483.811241:0:18595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383483.817135:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787383483.817195:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787383483.817212:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787383483.817226:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787383483.817240:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787383483.817268:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787383483.817310:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787383483.817316:0:18595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787383483.817417:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383483.817497:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.817550:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a73840 going to sleep for 11 seconds 00000100:00100000:3.0:1787383483.818033:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984954368 00000100:00100000:3.0:1787383483.818041:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984954368 00000100:00100000:3.0:1787383483.818097:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787383483.818106:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:18595:x1874206984954368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383483.818254:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:18595:x1874206984954368:12345-0@lo:501:mount.lustre.0 Request processed in 148us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383483.818261:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787383483.818398:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383483.818435:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383483.818496:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.819085:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a73840 going to sleep for 11 seconds 00000100:00100000:3.0:1787383483.819217:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984954496 00000100:00100000:3.0:1787383483.819223:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984954496 00000100:00100000:3.0:1787383483.819275:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787383483.819283:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:18595:x1874206984954496:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383483.820814:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:18595:x1874206984954496:12345-0@lo:503:mount.lustre.0 Request processed in 1516us (2302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383483.820832:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787383483.821084:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954496:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787383483.821539:0:18595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787383483.821632:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383483.821682:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.821720:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a73180 going to sleep for 11 seconds 00000100:00100000:2.0:1787383483.821984:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984954624 00000100:00100000:2.0:1787383483.821991:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984954624 00000100:00100000:2.0:1787383483.822031:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787383483.822038:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:18595:x1874206984954624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383483.822901:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:18595:x1874206984954624:12345-0@lo:502:mount.lustre.0 Request processed in 860us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383483.822922:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787383483.823185:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383483.823398:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787383483.823430:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787383483.823443:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787383483.823454:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787383483.823677:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787383483.823695:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787383483.823709:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787383483.823721:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787383483.823735:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787383483.823748:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787383483.823761:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787383483.823813:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787383483.823854:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383483.823983:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.824074:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a73180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383483.828129:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984954752 00000100:00100000:3.0:1787383483.828144:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984954752 00000100:00100000:3.0:1787383483.828243:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787383483.828255:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:18595:x1874206984954752:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383483.828444:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:18595:x1874206984954752:12345-0@lo:502:mount.lustre.0 Request processed in 191us (4460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383483.828453:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787383483.828827:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954752:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383483.828932:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787383483.828946:0:18595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787383483.833051:0:18612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787383483.833067:0:18612:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787383483.833074:0:18612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383483.833076:0:18612:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787383483.833083:0:18612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383483.833099:0:18612:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9636345a99c0) 00000020:00000080:0.0:1787383483.833125:0:18612:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787383483.833131:0:18612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787383483.833210:0:18612:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963638ad9800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787383483.833218:0:18612:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787383483.833224:0:18612:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc40acec91532f80c 00010000:00010000:0.0:1787383483.840738:0:18612:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1787383483.843525:0:18612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:1.0:1787383483.850477:0:18612:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1787383483.858370:0:18612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787383483.858382:0:18612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383483.858388:0:18612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383483.858390:0:18612:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787383483.858393:0:18612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787383483.858396:0:18612:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1787383483.858397:0:18612:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383483.858398:0:18612:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383483.858399:0:18612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787383483.858402:0:18612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383483.858403:0:18612:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787383483.858405:0:18612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383483.858407:0:18612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383483.858409:0:18612:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787383483.858411:0:18612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787383483.858413:0:18612:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787383483.858415:0:18612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383483.858418:0:18612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383483.858419:0:18612:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787383483.858421:0:18612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383483.858423:0:18612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383483.858425:0:18612:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787383483.858428:0:18612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787383483.858456:0:18612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383483.858459:0:18612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383483.858460:0:18612:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787383483.858463:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787383483.858629:0:18595:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787383483.858657:0:18595:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787383483.858684:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.858696:0:18595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383483.858705:0:18595:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff963638ad9800 from 1 10000000:01000000:0.0:1787383483.858708:0:18595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383483.858743:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.858751:0:18595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.858791:0:18595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383483.858816:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383483.858888:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383483.858931:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfa180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383483.862166:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984954880 00000100:00100000:3.0:1787383483.862179:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984954880 00000100:00100000:3.0:1787383483.862233:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787383483.862243:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:18595:x1874206984954880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383483.862260:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383483.862278:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963600030600/0xc40acec91532f81a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f813 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383483.862305:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963600030600/0xc40acec91532f81a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f813 expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383483.862316:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963600030600/0xc40acec91532f81a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f813 expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383483.862326:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030600, rc 0) 00000100:00100000:3.0:1787383483.862407:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:18595:x1874206984954880:12345-0@lo:101:mount.lustre.0 Request processed in 165us (3518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383483.862414:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787383483.862522:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984954880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383483.862550:0:18595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f81a expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.862558:0:18595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f81a expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383483.871635:0:18595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787383483.871927:0:18595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383483.872120:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787383483.872141:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787383483.872155:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787383483.872159:0:18595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787383483.872221:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383483.872278:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383483.872319:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608679300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383483.872493:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984955008 00000100:00100000:3.0:1787383483.872505:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984955008 00000100:00100000:3.0:1787383483.872554:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787383483.872561:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:18595:x1874206984955008:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383483.872666:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:18595:x1874206984955008:12345-0@lo:501:mount.lustre.0 Request processed in 105us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383483.872673:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787383483.873732:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383483.873814:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383483.873889:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.873913:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a73600 going to sleep for 11 seconds 00000100:00100000:3.0:1787383483.874209:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984955136 00000100:00100000:3.0:1787383483.874216:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984955136 00000100:00100000:3.0:1787383483.874258:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787383483.874265:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:18595:x1874206984955136:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383483.874371:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:18595:x1874206984955136:12345-0@lo:503:mount.lustre.0 Request processed in 105us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383483.874378:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787383483.874613:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955136:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787383483.875022:0:18595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787383483.875090:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955264:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383483.875131:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.875164:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360391c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383483.875292:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984955264 00000100:00100000:3.0:1787383483.875298:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984955264 00000100:00100000:3.0:1787383483.875332:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787383483.875339:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:18595:x1874206984955264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383483.875425:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:18595:x1874206984955264:12345-0@lo:502:mount.lustre.0 Request processed in 85us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383483.875433:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787383483.875509:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787383483.875687:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787383483.875711:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787383483.875723:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787383483.875734:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787383483.875745:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787383483.875756:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787383483.876083:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787383483.876110:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1787383483.876124:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787383483.876135:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1787383483.876148:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1787383483.876171:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383483.876213:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383483.876294:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff963608679540 going to sleep for 11 seconds 00000100:00100000:3.0:1787383483.876997:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984955392 00000100:00100000:3.0:1787383483.877004:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984955392 00000100:00100000:3.0:1787383483.877148:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787383483.877157:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:18595:x1874206984955392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383483.877284:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:18595:x1874206984955392:12345-0@lo:502:mount.lustre.0 Request processed in 127us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383483.877302:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787383483.877631:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383483.877702:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1787383483.877714:0:18595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787383483.880343:0:18616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383483.880356:0:18616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383483.880359:0:18616:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787383483.880374:0:18616:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff963638ad9800 00000020:00000080:0.0:1787383483.880377:0:18616:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383483.880384:0:18616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383483.880387:0:18616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383483.880388:0:18616:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787383483.880390:0:18616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383483.880393:0:18616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383483.880395:0:18616:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787383483.880398:0:18616:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff963638ad9800 00000020:00000080:0.0:1787383483.880401:0:18616:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383483.880469:0:18616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383483.880473:0:18616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383483.880475:0:18616:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787383483.880478:0:18616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383483.880480:0:18616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383483.880481:0:18616:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383483.880485:0:18616:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963638ad9800 00000020:00000080:0.0:1787383483.880487:0:18616:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383483.880504:0:18616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383483.880508:0:18616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383483.880509:0:18616:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383483.880511:0:18616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383483.880514:0:18616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383483.880515:0:18616:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787383483.880518:0:18616:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963638ad9800 00000020:00000080:0.0:1787383483.880521:0:18616:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383483.880553:0:18616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383483.880556:0:18616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383483.880557:0:18616:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787383483.880560:0:18616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787383483.880828:0:18595:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787383483.880854:0:18595:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383483.881090:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f81a expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.881107:0:18595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f81a expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383483.881156:0:18595:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787383483.881159:0:18595:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff963638ad9800 10000000:01000000:0.0:1787383483.881162:0:18595:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff963638ad9800 10000000:01000000:0.0:1787383483.881167:0:18595:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383483.881172:0:18595:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff963638ad9800 from 1 10000000:01000000:0.0:1787383483.881174:0:18595:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787383483.881208:0:18595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.881217:0:18595:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.881227:0:18595:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383483.881251:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383483.881319:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383483.884477:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfa840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383483.884561:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984955520 00000100:00100000:2.0:1787383483.884570:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984955520 00000100:00100000:2.0:1787383483.884623:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787383483.884632:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:18595:x1874206984955520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383483.884655:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383483.884672:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c8000/0xc40acec91532f828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f821 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.884699:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c8000/0xc40acec91532f828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f821 expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.884710:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c8000/0xc40acec91532f828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f821 expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.884720:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8000, rc 0) 00000100:00100000:0.0:1787383483.885036:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955520:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383483.885053:0:18595:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.885062:0:18595:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383483.885585:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:18595:x1874206984955520:12345-0@lo:101:mount.lustre.0 Request processed in 167us (3478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383483.885595:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000040:00080000:1.0:1787383483.889975:0:18595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787383483.890283:0:18595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383483.891761:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787383483.891909:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787383483.891935:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787383483.891951:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787383483.891972:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787383483.891987:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787383483.892009:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787383483.892025:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787383483.892047:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787383483.892067:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787383483.892092:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787383483.892107:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787383483.892130:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787383483.892151:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787383483.892166:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787383483.892187:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787383483.892201:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787383483.892223:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787383483.892237:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787383483.892248:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787383483.892260:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787383483.892272:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787383483.892294:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787383483.892307:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787383483.892343:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787383483.892378:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787383483.892393:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787383483.892406:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787383483.892417:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787383483.892429:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787383483.892440:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787383483.892451:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787383483.892463:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787383483.892477:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787383483.892490:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787383483.892502:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787383483.892514:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787383483.892533:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787383483.892539:0:18595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787383483.892653:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383483.892725:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.892805:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383483.893033:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984955648 00000100:00100000:0.0:1787383483.893040:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984955648 00000100:00100000:0.0:1787383483.893240:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787383483.893249:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:18595:x1874206984955648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383483.893358:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:18595:x1874206984955648:12345-0@lo:501:mount.lustre.0 Request processed in 109us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383483.893366:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787383483.895915:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383483.895993:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383483.896075:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.896126:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383483.896989:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984955776 00000100:00100000:0.0:1787383483.896998:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984955776 00000100:00100000:0.0:1787383483.897121:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787383483.898482:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:18595:x1874206984955776:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383483.898655:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:18595:x1874206984955776:12345-0@lo:503:mount.lustre.0 Request processed in 1525us (2580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383483.898665:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787383483.898836:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955776:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787383483.899411:0:18595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787383483.899663:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383483.899716:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.899752:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383483.900186:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984955904 00000100:00100000:0.0:1787383483.900193:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984955904 00000100:00100000:0.0:1787383483.900233:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787383483.900243:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:18595:x1874206984955904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383483.900349:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:18595:x1874206984955904:12345-0@lo:502:mount.lustre.0 Request processed in 107us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383483.900358:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787383483.900574:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984955904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383483.900752:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787383483.900819:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787383483.900834:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787383483.900847:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787383483.900858:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787383483.900883:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787383483.900897:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787383483.900908:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787383483.900936:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787383483.900951:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787383483.900966:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787383483.900979:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787383483.900992:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787383483.901004:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787383483.901017:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787383483.901030:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787383483.901042:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787383483.901053:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787383483.901065:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787383483.901078:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787383483.901093:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787383483.901105:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787383483.901130:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787383483.901145:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787383483.901169:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1787383483.901184:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1787383483.901197:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1787383483.901209:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1787383483.901222:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1787383483.901235:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1787383483.901247:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1787383483.901260:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1787383483.901273:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1787383483.901284:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1787383483.901297:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1787383483.901310:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1787383483.901322:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1787383483.901334:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1787383483.901346:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1787383483.901377:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1787383483.901403:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1787383483.901418:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1787383483.901429:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1787383483.901440:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1787383483.901453:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1787383483.901466:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1787383483.901479:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1787383483.901492:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1787383483.901535:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984956032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383483.901588:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.901628:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984956032 00000100:00100000:1.0:1787383483.901633:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984956032 00000100:00100000:1.0:1787383483.901670:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787383483.901677:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:18595:x1874206984956032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383483.901790:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:18595:x1874206984956032:12345-0@lo:502:mount.lustre.0 Request processed in 89us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383483.901797:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787383483.901845:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383483.901876:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984956032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383483.902014:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1787383483.902035:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1787383483.902056:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984956160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383483.902088:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.902111:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984956160 00000100:00100000:1.0:1787383483.902114:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984956160 00000100:00100000:1.0:1787383483.902137:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787383483.902143:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:18595:x1874206984956160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383483.902201:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:18595:x1874206984956160:12345-0@lo:502:mount.lustre.0 Request processed in 57us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383483.902208:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787383483.902241:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383483.902253:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984956160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383483.902285:0:18595:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1787383483.902292:0:18595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787383483.907077:0:18621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787383483.907802:0:18621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96363cd50000) 00000020:00000080:3.0:1787383483.907830:0:18621:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1787383483.908029:0:18621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963638ad9800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787383483.908033:0:18621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963638ad9800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787383483.908035:0:18621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963638ad9800 3 00010000:00080000:3.0:1787383483.908065:0:18621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96363cd5b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1787383483.918689:0:18621:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1787383483.919093:0:18621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787383483.919902:0:18621:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787383483.919917:0:18621:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc40acec91532f836 00000100:00080000:2.0:1787383483.919926:0:18621:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383483.919932:0:18621:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96363cd5b000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383483.919969:0:18621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362d919880 x1874206984956288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383483.919994:0:18621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787383483.920217:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984956288:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787383483.920282:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383483.920314:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984956288 00000100:00100000:1.0:1787383483.920322:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984956288 00000100:00100000:1.0:1787383483.920351:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383483.920359:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1874206984956288:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787383483.920383:0:17096:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000100:00080000:3.0:1787383483.920412:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383483.920418:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383483.920421:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383483.920425:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:1.0:1787383483.920429:0:17096:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc40acec91532f83d 00000004:00100000:1.0:1787383483.920445:0:17096:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787383483.920469:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383483.920473:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383483.920474:0:17096:0:(import.c:65:import_set_state_nolock()) ffff963611228800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787383483.920477:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383483.920482:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:2.0:1787383483.920488:0:18621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787383483.920502:0:18621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff963627ae19c0) 00000100:00100000:3.0:1787383483.920517:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984956544:0@lo:400:kworker.0 00000020:00000080:2.0:1787383483.920520:0:18621:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000100:00100000:1.0:1787383483.920528:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874206984956288:12345-0@lo:38:llog_process_th.0 Request processed in 168us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383483.920536:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383483.920553:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383483.920576:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383483.920582:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984956672:0@lo:400:kworker.0 00000100:00100000:3.0:1787383483.920607:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383483.920687:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984956416:0@lo:400:kworker.0 00000100:00100000:0.0:1787383483.920716:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383483.920745:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383483.920751:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984956800:0@lo:400:kworker.0 00000100:00100000:1.0:1787383483.920941:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984956544 00000100:00100000:1.0:1787383483.920946:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984956544 00000100:00100000:1.0:1787383483.920974:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787383483.920980:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984956544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383483.921017:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984956544:12345-0@lo:400:kworker.0 Request processed in 36us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383483.921024:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787383483.921064:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963503f6a680 x1874206984956544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383483.921078:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984956544:0@lo:400:kworker.0 00000020:01000004:2.0:1787383483.921099:0:18621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963638ad9800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787383483.921103:0:18621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963638ad9800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787383483.921106:0:18621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963638ad9800 3 00010000:00080000:1.0:1787383483.921109:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96362d919880 x1874206984956288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383483.921117:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787383483.921123:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00010000:00080000:2.0:1787383483.921129:0:18621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9635036f5800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.102@tcp at head 00000100:00080000:1.0:1787383483.921129:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787383483.921133:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787383483.921135:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787383483.921140:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984956288:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787383483.921673:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383483.921717:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984956672 00000100:00100000:0.0:1787383483.921722:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984956672 00000100:00100000:0.0:1787383483.921749:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984956416 00000100:00100000:0.0:1787383483.921752:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984956416 00000100:00100000:0.0:1787383483.921787:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787383483.921795:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984956672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383483.921835:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984956672:12345-0@lo:400:kworker.0 Request processed in 41us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383483.921842:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787383483.921854:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787383483.921871:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984956416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383483.922514:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984956800 00000100:00100000:1.0:1787383483.922528:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984956800 00000100:00100000:1.0:1787383483.922560:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787383483.922567:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984956800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383483.922618:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984956416:12345-0@lo:400:kworker.0 Request processed in 757us (1899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383483.922625:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787383483.922667:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984956800:12345-0@lo:400:kworker.0 Request processed in 100us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383483.922673:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787383483.922709:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984956672:0@lo:400:kworker.0 00010000:00010000:2.0:1787383483.923957:0:18621:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1787383483.924138:0:18621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787383483.924186:0:18621:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787383483.924198:0:18621:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc40acec91532f84b 00000100:00080000:2.0:1787383483.924206:0:18621:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383483.924213:0:18621:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9635036f5800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383483.924245:0:18621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362d91b800 x1874206984956928/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383483.924275:0:18621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787383483.924311:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383483.924317:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383483.924326:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1787383483.924674:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1874206984956928:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787383483.924748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787383483.925065:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383483.925070:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383483.925074:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383483.925076:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383483.925078:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787383483.925851:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984956928 00000100:00100000:2.0:1787383483.925871:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984956928 00000100:00100000:2.0:1787383483.925993:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787383483.926001:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984956928:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787383483.926099:0:17094:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1787383483.926134:0:17094:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc40acec91532f852 00000004:00100000:2.0:1787383483.926153:0:17094:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787383483.926187:0:17094:0:(import.c:65:import_set_state_nolock()) ffff963622dcb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383483.927710:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874206984956928:12345-0@lo:38:llog_process_th.0 Request processed in 1702us (2956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383483.927722:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1787383483.927852:0:18621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00010000:00080000:0.0:1787383483.928012:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963503f6ad80 x1874206984956800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383483.928164:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984956800:0@lo:400:kworker.0 00000100:00100000:0.0:1787383483.928183:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984956416:0@lo:400:kworker.0 00000020:01000000:0.0:1787383483.928455:0:18595:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787383483.928493:0:18595:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787383483.928605:0:18595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.928616:0:18595:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787383483.928663:0:18595:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787383483.928665:0:18595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787383483.928667:0:18595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383483.928668:0:18595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383483.928669:0:18595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383483.928671:0:18595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383483.928672:0:18595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383483.928674:0:18595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383483.928675:0:18595:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787383483.928679:0:18595:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787383483.928681:0:18595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787383483.928682:0:18595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787383483.928683:0:18595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383483.928684:0:18595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383483.928685:0:18595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383483.928686:0:18595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383483.928687:0:18595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383483.928688:0:18595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383483.928689:0:18595:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787383483.928711:0:18595:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787383483.928728:0:18595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984957056:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787383483.928814:0:18595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383483.928838:0:18595:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfad80 going to sleep for 11 seconds 00010000:00080000:3.0:1787383483.930065:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96362d91b800 x1874206984956928/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383483.930078:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787383483.930086:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787383483.930095:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787383483.930101:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787383483.930104:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9635036f5800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787383483.930111:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1874206984956928:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787383483.931578:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984957056 00000100:00100000:1.0:1787383483.931589:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984957056 00000100:00100000:1.0:1787383483.931640:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787383483.931649:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:18595:x1874206984957056:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787383483.931683:0:17086:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787383483.931695:0:17086:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787383483.934273:0:17086:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787383483.934293:0:17086:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787383483.934846:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:18595:x1874206984957056:12345-0@lo:253:mount.lustre.0 Request processed in 3192us (6027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383483.934868:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787383483.934998:0:18595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:18595:1874206984957056:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787383483.935012:0:18595:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787383483.935016:0:18595:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787383483.935029:0:18595:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787383483.935030:0:18595:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383483.935032:0:18595:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383483.935033:0:18595:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383483.935034:0:18595:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383483.935036:0:18595:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383483.935038:0:18595:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383483.935039:0:18595:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787383483.935058:0:18595:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787383483.935490:0:17110:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787383483.935495:0:17110:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787383483.935515:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383483.935531:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96360516d600/0xc40acec91532f7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f79c expref: 21 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383483.935539:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963610f16c00/0xc40acec91532f7b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f7aa expref: 21 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383483.935558:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383483.935590:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963610f16c00/0xc40acec91532f7b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532f7aa expref: 21 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383483.935615:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff963610f16c00/0xc40acec91532f7b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532f7aa expref: 21 pid: 17088 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383483.935627:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984957184:0@lo:104: 00000100:00100000:3.0:1787383483.935670:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787383483.935716:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96360516d600/0xc40acec91532f7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532f79c expref: 21 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383483.935724:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96360516d600/0xc40acec91532f7a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532f79c expref: 21 pid: 17088 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383483.935733:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984957312:0@lo:104: 00000100:00100000:3.0:1787383483.935756:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383483.935788:0:17110:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383483.935805:0:17078:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787383483.935817:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984957184 00000100:00100000:0.0:1787383483.935822:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984957184 00000100:00100000:0.0:1787383483.935849:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984957312 00000100:00100000:0.0:1787383483.935853:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984957312 00000100:00100000:0.0:1787383483.935887:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383483.935896:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+4:17110:x1874206984957184:12345-0@lo:104: 00010000:00010000:0.0:1787383483.935908:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f7b1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.935955:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787383483.935960:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+4:17110:x1874206984957184:12345-0@lo:104: Request processed in 67us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383483.935967:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383483.935980:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787383483.935986:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636092d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:17110:x1874206984957312:12345-0@lo:104: 00010000:00010000:0.0:1787383483.935993:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f7a3 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.936032:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787383483.936038:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984957184:0@lo:104: 00000100:00100000:0.0:1787383483.936038:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636092d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:17110:x1874206984957312:12345-0@lo:104: Request processed in 52us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383483.936044:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383483.936046:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984957312:0@lo:104: 00010000:00010000:3.0:1787383483.936061:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383483.936076:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383483.936076:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383483.936081:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f7b1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.936088:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030000 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383483.936092:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532f7b1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.936106:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532f7b1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383483.936113:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532f7b1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383483.936118:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787383483.936150:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f7b1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.936157:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383483.936175:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f7b1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.936182:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963600030000/0xc40acec91532f7aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f7b1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.936191:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383483.936193:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383483.936194:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383483.936204:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984957440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383483.936232:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383483.936263:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984957440 00000100:00100000:0.0:1787383483.936267:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984957440 00010000:00010000:0.0:1787383483.936282:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963610f16c00/0xc40acec91532f7b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f7aa expref: 22 pid: 17088 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383483.936310:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383483.936317:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:3650:x1874206984957440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383483.936334:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383483.936340:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963610f16c00/0xc40acec91532f7b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f7aa expref: 22 pid: 17088 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.936350:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963610f16c00/0xc40acec91532f7b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532f7aa expref: 22 pid: 17088 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.936363:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963610f16c00/0xc40acec91532f7b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532f7aa expref: 22 pid: 17088 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383483.936373:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383483.936401:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:3650:x1874206984957440:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383483.936407:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383483.936433:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984957440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383483.941685:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383483.941690:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383483.941699:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787383483.941895:0:18595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1787383483.946407:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f7a3 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383483.946425:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17a00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383483.946430:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532f7a3 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383483.946441:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532f7a3 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383483.946449:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532f7a3 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383483.946468:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383483.946521:0:17082:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f7a3 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383483.946528:0:17082:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383483.946559:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f7a3 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383483.946567:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec91532f79c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f7a3 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383483.946584:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383483.946586:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383483.946588:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383483.946596:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383483.946615:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984957568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383483.946680:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383483.946793:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984957568 00000100:00100000:2.0:1787383483.946801:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984957568 00010000:00010000:2.0:1787383483.946828:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96360516d600/0xc40acec91532f7a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f79c expref: 20 pid: 17088 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383483.946877:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787383483.946886:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605015050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:3648:x1874206984957568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383483.946898:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383483.946904:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96360516d600/0xc40acec91532f7a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f79c expref: 20 pid: 17088 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.946915:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96360516d600/0xc40acec91532f7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532f79c expref: 20 pid: 17088 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.946929:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96360516d600/0xc40acec91532f7a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532f79c expref: 20 pid: 17088 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.946943:0:17080:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.946951:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787383483.946967:0:17080:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011472102s 00010000:00010000:2.0:1787383483.946971:0:17080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.946979:0:17080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.946986:0:17080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.946992:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.947004:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383483.947008:0:17080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.947016:0:17080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.947049:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383483.947060:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383483.947098:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605015050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:3648:x1874206984957568:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383483.947105:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787383483.948535:0:17110:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383483.948551:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383483.948558:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963600030800/0xc40acec91532f859 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383483.948607:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984957568:0@lo:103:ldlm_bl.0 00002000:00080000:1.0:1787383483.956094:0:18595:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787383483.956101:0:18595:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787383483.956143:0:18595:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787383483.956192:0:18595:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787383483.956224:0:18595:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787383483.956241:0:18595:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787383483.964504:0:18595:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787383483.965647:0:18595:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787383484.060199:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787383484.884344:0:18676:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383484.884555:0:18676:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787383485.085418:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383485.085535:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984957696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383485.085553:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383485.085566:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984957824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383485.085602:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383485.085887:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383485.090550:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984957696 00000100:00100000:0.0:1787383485.090560:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984957696 00000100:00100000:2.0:1787383485.093143:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984957824 00000100:00100000:2.0:1787383485.093158:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984957824 00000100:00100000:2.0:1787383485.093257:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787383485.093269:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984957696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383485.093311:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787383485.093396:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984957696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (7793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383485.093403:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787383485.093420:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787383485.093427:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984957824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787383485.093456:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787383485.093493:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984957824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (7605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383485.093499:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787383485.093572:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984957696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383485.093613:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984957824:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1787383485.851811:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787383485.851818:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff963636f5c800 from 9 10000000:01000000:2.0:1787383485.851822:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787383485.851877:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.851889:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.851899:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383485.851921:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984957952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383485.851982:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383485.852017:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963607fc0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383485.852037:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984957952 00000100:00100000:2.0:1787383485.852043:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984957952 00000100:00100000:2.0:1787383485.852096:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787383485.852105:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:17091:x1874206984957952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383485.852118:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383485.852131:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c8400/0xc40acec91532f867 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f860 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.852164:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c8400/0xc40acec91532f867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f860 expref: 20 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.852175:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c8400/0xc40acec91532f867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f860 expref: 20 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.852184:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8400, rc 0) 00000100:00100000:2.0:1787383485.852223:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:17091:x1874206984957952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383485.852230:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787383485.852276:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984957952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383485.852290:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f867 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.852298:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f867 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383485.852346:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984958080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787383485.852374:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383485.852398:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963607fc0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383485.852516:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984958080 00000100:00100000:1.0:1787383485.852521:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984958080 00000100:00100000:1.0:1787383485.852544:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787383485.852551:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:17091:x1874206984958080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787383485.852564:0:17086:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787383485.852580:0:17086:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787383485.852583:0:17086:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787383485.852661:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:17091:x1874206984958080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383485.852669:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787383485.864005:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984958080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787383485.864081:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787383485.864091:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f867 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.864103:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f867 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383485.864118:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787383485.864120:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff963620e92000 from 9 10000000:01000000:2.0:1787383485.864124:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787383485.864154:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.864162:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.864170:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383485.864189:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984958208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383485.864240:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383485.864272:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963607fc0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383485.864293:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984958208 00000100:00100000:2.0:1787383485.864297:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984958208 00000100:00100000:2.0:1787383485.864335:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787383485.864342:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:17091:x1874206984958208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383485.864353:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383485.864364:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c9200/0xc40acec91532f875 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f86e expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.864385:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9200/0xc40acec91532f875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f86e expref: 21 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.864394:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c9200/0xc40acec91532f875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f86e expref: 21 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.864411:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9200, rc 0) 00000100:00100000:2.0:1787383485.864442:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:17091:x1874206984958208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383485.864449:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787383485.864485:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984958208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383485.864495:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f875 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.864503:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f875 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383485.864538:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984958336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787383485.864564:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383485.864577:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963607fc0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383485.864588:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984958336 00000100:00100000:2.0:1787383485.864590:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984958336 00000100:00100000:2.0:1787383485.864608:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787383485.864613:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:17091:x1874206984958336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787383485.864625:0:17089:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787383485.864638:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787383485.864641:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1787383485.864702:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:17091:x1874206984958336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 87us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383485.864708:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787383485.864734:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984958336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787383485.864792:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787383485.864797:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f875 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383485.864805:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f875 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383486.107475:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383487.130974:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383488.157165:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787383488.540607:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787383489.179135:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787383489.180220:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383489.180225:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383489.180229:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383489.180232:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383489.180247:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383489.180249:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383489.180252:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383489.180254:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787383489.180292:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984958848:0@lo:400:kworker.0 00000100:00100000:1.0:1787383489.180360:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383489.180393:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984958592:0@lo:400:kworker.0 00000100:00100000:0.0:1787383489.180432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383489.180444:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787383489.180454:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984958464:0@lo:400:kworker.0 00000100:00100000:0.0:1787383489.180465:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984959104:0@lo:400:kworker.0 00000100:00100000:2.0:1787383489.180550:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984958720:0@lo:400:kworker.0 00000100:00100000:0.0:1787383489.182067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383489.182144:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984959104 00000100:00100000:3.0:1787383489.182153:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984959104 00000100:00100000:3.0:1787383489.182212:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383489.182222:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984959104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383489.182278:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984959104:12345-0@lo:400:kworker.0 Request processed in 57us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383489.182285:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787383489.182329:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da0b480 x1874206984959104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383489.182342:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984959104:0@lo:400:kworker.0 00000100:00100000:1.0:1787383489.182389:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787383489.182499:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383489.182523:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984958976:0@lo:400:kworker.0 00000100:00100000:1.0:1787383489.182567:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383489.182600:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984958848 00000100:00100000:1.0:1787383489.182605:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984958848 00000100:00100000:1.0:1787383489.182631:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984958592 00000100:00100000:1.0:1787383489.182635:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984958592 00000100:00100000:1.0:1787383489.182648:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787383489.182654:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984958848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383489.182693:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984958848:12345-0@lo:400:kworker.0 Request processed in 39us (2333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383489.182700:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787383489.182712:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787383489.182717:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984958592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383489.182749:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984958592:12345-0@lo:400:kworker.0 Request processed in 31us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383489.182754:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787383489.182808:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984958976 00000100:00100000:0.0:1787383489.182820:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984958976 00000100:00100000:0.0:1787383489.182857:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383489.182863:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984958976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383489.183029:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984958848:0@lo:400:kworker.0 00000100:00100000:0.0:1787383489.183160:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984958976:12345-0@lo:400:kworker.0 Request processed in 295us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383489.183167:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787383489.183199:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da09180 x1874206984958976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383489.183210:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984958976:0@lo:400:kworker.0 00000100:00100000:2.0:1787383489.183987:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383489.184017:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984959232:0@lo:400:kworker.0 00000100:00100000:2.0:1787383489.184047:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383489.184203:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984958464 00000100:00100000:3.0:1787383489.184209:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984958464 00000100:00100000:3.0:1787383489.184247:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787383489.184255:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:3649:x1874206984958464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383489.185959:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:3649:x1874206984958464:12345-0@lo:400:kworker.0 Request processed in 1697us (3562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383489.185971:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787383489.186930:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984958720 00000100:00100000:0.0:1787383489.187445:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984958720 00000100:00100000:0.0:1787383489.187492:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984959232 00000100:00100000:0.0:1787383489.187495:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984959232 00000100:00100000:0.0:1787383489.187530:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787383489.187539:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984958720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383489.187742:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984958720:12345-0@lo:400:kworker.0 Request processed in 203us (3755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383489.187749:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787383489.187786:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787383489.187794:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984959232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383489.187836:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984959232:12345-0@lo:400:kworker.0 Request processed in 32us (3778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383489.187842:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787383489.187866:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787383489.188953:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da0a680 x1874206984959232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383489.188969:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984959232:0@lo:400:kworker.0 00010000:00080000:2.0:1787383489.189188:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da09500 x1874206984958720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383489.189199:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984958720:0@lo:400:kworker.0 00000100:00100000:2.0:1787383489.189363:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984958592:0@lo:400:kworker.0 00000100:00100000:2.0:1787383489.189394:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984958464:0@lo:400:kworker.0 00000001:02000400:1.0:1787383489.438515:0:18966:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787383490.203062:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383490.203073:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383490.203093:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984959360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383490.203160:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383490.203225:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984959360 00000100:00100000:3.0:1787383490.203232:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984959360 00000100:00100000:3.0:1787383490.203274:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383490.203284:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984959360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787383490.203317:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787383490.203360:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984959360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383490.203367:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383490.203409:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984959360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383490.203616:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383490.203626:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984959488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383490.203653:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383490.203879:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984959488 00000100:00100000:0.0:1787383490.203884:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984959488 00000100:00100000:0.0:1787383490.203917:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787383490.203933:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984959488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383490.203954:0:17835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787383490.204000:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984959488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383490.204007:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787383490.204066:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984959488:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1787383490.381211:0:19018:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787383490.381620:0:19018:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1787383491.185054:0:19068:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383491.185498:0:19068:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787383491.227619:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787383491.996135:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787383492.251079:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383493.274942:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383494.174325:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383479/real 1787383479] req@ffff96362da08e00 x1874206984952960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383494 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383494.174361:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96362da08e00 x1874206984952960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383494 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383494.174373:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383479/real 1787383479] req@ffff963503fda680 x1874206984952704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383494 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383494.174386:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503fda680 x1874206984952704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383494 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787383494.174406:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363505e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383494.174432:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787383494.174437:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984952960:0@lo:8:kworker.0 00000100:00080000:0.0:1787383494.174443:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9635036f7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383494.174449:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787383494.174453:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984952704:0@lo:8:kworker.0 00000100:00080000:3.0:1787383494.174579:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383494.174584:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383494.174587:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383494.174589:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383494.174614:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383494.174617:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787383494.174620:0:36:0:(import.c:65:import_set_state_nolock()) ffff96363505e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383494.174624:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 512 00000100:00080000:3.0:1787383494.174630:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787383494.174637:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96363505e800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383494.174657:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f69500 x1874206984960128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787383494.174670:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383494.174684:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787383494.174686:0:36:0:(import.c:65:import_set_state_nolock()) ffff9635036f7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383494.174690:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 512 00000100:00080000:3.0:1787383494.174692:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787383494.174696:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9635036f7800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383494.174709:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f6a680 x1874206984960256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787383494.174752:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984960000:0@lo:400:kworker.0 00000100:00100000:3.0:1787383494.174844:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383494.174892:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787383494.174899:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984959872:0@lo:400:kworker.0 00000100:00100000:3.0:1787383494.174925:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383494.174941:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984960640:0@lo:400:kworker.0 00000100:00100000:3.0:1787383494.174962:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383494.174993:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984960000 00000100:00100000:3.0:1787383494.175001:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984960000 00000100:00100000:3.0:1787383494.175042:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787383494.175050:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984960000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383494.175101:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984960000:12345-0@lo:400:kworker.0 Request processed in 51us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383494.175109:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787383494.175144:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984960000:0@lo:400:kworker.0 00000100:00100000:0.0:1787383494.175209:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984959744:0@lo:400:kworker.0 00000100:00100000:0.0:1787383494.175313:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383494.175345:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984960512:0@lo:400:kworker.0 00000100:00100000:0.0:1787383494.175378:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383494.175398:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787383494.175405:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984959616:0@lo:400:kworker.0 00000100:00100000:0.0:1787383494.175432:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383494.175453:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984960384:0@lo:400:kworker.0 00000100:00100000:0.0:1787383494.175474:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383494.175493:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984960128:0@lo:8:kworker.0 00000100:00100000:0.0:1787383494.175522:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383494.175547:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984960256:0@lo:8:kworker.0 00000100:00100000:0.0:1787383494.175570:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383494.175595:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984959872 00000100:00100000:0.0:1787383494.175599:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984959872 00000100:00100000:0.0:1787383494.175620:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984960640 00000100:00100000:0.0:1787383494.175623:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984960640 00000100:00100000:0.0:1787383494.175642:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984960512 00000100:00100000:0.0:1787383494.175645:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984960512 00000100:00100000:0.0:1787383494.175658:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984960384 00000100:00100000:0.0:1787383494.175661:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984960384 00000100:00100000:0.0:1787383494.175674:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383494.175680:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984959872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383494.175718:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984959872:12345-0@lo:400:kworker.0 Request processed in 38us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383494.175725:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383494.175739:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383494.175745:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984960640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383494.175809:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984960640:12345-0@lo:400:kworker.0 Request processed in 64us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383494.175825:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383494.175837:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787383494.175844:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984960512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383494.176108:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984959744 00000100:00100000:3.0:1787383494.176112:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984959744 00000100:00100000:3.0:1787383494.176138:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383494.176145:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984959744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383494.176189:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984959744:12345-0@lo:400:kworker.0 Request processed in 44us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383494.176195:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383494.176221:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984960128 00000100:00100000:3.0:1787383494.176225:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984960128 00000100:00100000:3.0:1787383494.176253:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984960256 00000100:00100000:3.0:1787383494.176256:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984960256 00000100:00100000:3.0:1787383494.176268:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383494.176272:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1874206984960128:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787383494.176298:0:18600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:3.0:1787383494.176328:0:18600:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532f87c 00002000:00100000:3.0:1787383494.176341:0:18600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff96363cd59000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787383494.176345:0:18600:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787383494.176349:0:18600:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787383494.176518:0:18600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787383494.176542:0:18600:0:(import.c:65:import_set_state_nolock()) ffff96363cd5e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383494.176580:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1874206984960128:12345-0@lo:8:kworker.0 Request processed in 306us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383494.176587:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787383494.176600:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383494.176605:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1874206984960256:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787383494.176617:0:18600:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787383494.176872:0:17094:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787383494.176881:0:17094:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787383494.176993:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383494.177001:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984960384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383494.177039:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984960384:12345-0@lo:400:kworker.0 Request processed in 40us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383494.177045:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787383494.177226:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383494.177231:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383494.177243:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984959616 00000100:00100000:2.0:1787383494.177248:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984959616 00000100:00100000:2.0:1787383494.177278:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787383494.177285:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:3648:x1874206984959616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383494.177318:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:3648:x1874206984959616:12345-0@lo:400:kworker.0 Request processed in 34us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383494.177323:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1787383494.177378:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963503f6aa00 x1874206984959872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383494.177391:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984959872:0@lo:400:kworker.0 00010000:00080000:2.0:1787383494.177403:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963503f69880 x1874206984960640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383494.177411:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984960640:0@lo:400:kworker.0 00000100:00100000:0.0:1787383494.178922:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984960512:12345-0@lo:400:kworker.0 Request processed in 3070us (3534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383494.178936:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787383494.178993:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984959616:0@lo:400:kworker.0 00010000:00080000:0.0:1787383494.179009:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963503f6bb80 x1874206984960384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383494.179021:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984960384:0@lo:400:kworker.0 00000100:00100000:0.0:1787383494.179034:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984959744:0@lo:400:kworker.0 00010000:00080000:0.0:1787383494.179045:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963503f6b480 x1874206984960512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383494.179053:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984960512:0@lo:400:kworker.0 00010000:00080000:0.0:1787383494.179091:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963503f69500 x1874206984960128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383494.179099:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787383494.179107:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787383494.179115:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787383494.179120:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787383494.179123:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363505e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787383494.179156:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787383494.179163:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984960128:0@lo:8:kworker.0 00000004:00080000:0.0:1787383494.179200:0:17836:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787383494.179537:0:17837:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787383494.179566:0:17837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17837:1874206984960896:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1787383494.179616:0:17837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383494.179639:0:17837:0:(client.c:2702:ptlrpc_set_wait()) set ffff963604a92a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383494.179650:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383494.179658:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984960768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383494.179678:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383494.179704:0:18602:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787383494.179711:0:18602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787383494.179835:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984960896 00000100:00100000:2.0:1787383494.179840:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984960896 00000100:00080000:2.0:1787383494.179882:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383494.179948:0:19237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787383494.179956:0:19237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17837:x1874206984960896:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1787383494.180204:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984960768 00000100:00100000:2.0:1787383494.180208:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984960768 00000100:00100000:2.0:1787383494.180234:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383494.180241:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874206984960768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787383494.180257:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787383494.180299:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1874206984960768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383494.180305:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787383494.180333:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96350447bb80 x1874206984960768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383494.180347:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984960768:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1787383494.180379:0:17836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 527208612079ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787383494.180386:0:17836:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1787383494.182827:0:17827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1787383494.184881:0:19237:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787383494.184892:0:19237:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787383494.184992:0:19237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17837:x1874206984960896:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5032us (5371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383494.185012:0:19237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787383494.185107:0:17837:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96350447ad80 x1874206984960896/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787383510 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383494.185123:0:17837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17837:1874206984960896:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787383494.185135:0:17837:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787383494.185187:0:17837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17837:1874206984961024:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787383494.185224:0:17837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383494.185252:0:17837:0:(client.c:2702:ptlrpc_set_wait()) set ffff963628fa0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383494.185303:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984961024 00000100:00100000:2.0:1787383494.185310:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984961024 00000100:00100000:2.0:1787383494.185354:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383494.185364:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17837:x1874206984961024:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787383494.185388:0:18602:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787383494.185433:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17837:x1874206984961024:12345-0@lo:5:osp-pre-0-1.0 Request processed in 70us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383494.185439:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787383494.185828:0:17837:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da09880 x1874206984961024/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383510 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383494.185840:0:17837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17837:1874206984961024:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787383494.185849:0:17837:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787383494.185969:0:17837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fda300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17837:1874206984961152:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787383494.185995:0:17837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383494.186016:0:17837:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397600 going to sleep for 11 seconds 00000100:00100000:2.0:1787383494.186498:0:19237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984961152 00000100:00100000:2.0:1787383494.186504:0:19237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984961152 00000100:00100000:2.0:1787383494.186546:0:19237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787383494.186554:0:19237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17837:x1874206984961152:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787383494.186584:0:19237:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1787383494.193824:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1874206984960256:12345-0@lo:8:kworker.0 Request processed in 17208us (18244us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787383494.193837:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787383494.194354:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9635036f7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383494.194361:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787383494.194365:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984960256:0@lo:8:kworker.0 00000001:00080000:1.0:1787383494.211882:0:18596:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787383494.211897:0:18596:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787383494.212159:0:19237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17837:x1874206984961152:12345-0@lo:5:osp-pre-0-1.0 Request processed in 25601us (26158us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787383494.212169:0:19237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787383494.212245:0:17837:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963503fda300 x1874206984961152/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383510 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383494.212258:0:17837:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787383494.212264:0:17837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fda300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17837:1874206984961152:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787383494.212279:0:17837:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1787383494.212331:0:17837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fda300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17837:1874206984961280:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787383494.212368:0:17837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383494.212432:0:17837:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397600 going to sleep for 11 seconds 00000100:00100000:2.0:1787383494.212661:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984961280 00000100:00100000:2.0:1787383494.212668:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984961280 00000100:00100000:2.0:1787383494.212750:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383494.212759:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17837:x1874206984961280:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787383494.212850:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17837:x1874206984961280:12345-0@lo:900:osp-pre-0-1.0 Request processed in 92us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383494.212857:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787383494.212945:0:17837:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963503fda300 x1874206984961280/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787383510 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383494.212956:0:17837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fda300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17837:1874206984961280:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1787383494.298988:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383495.323349:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787383495.323382:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984961408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383495.323496:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383495.323552:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984961536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383495.323564:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984961408 00000100:00100000:3.0:1787383495.323577:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984961408 00000100:00100000:0.0:1787383495.323592:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383495.323626:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984961536 00000100:00100000:2.0:1787383495.323633:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984961536 00000100:00100000:2.0:1787383495.323694:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787383495.323705:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984961536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383495.323750:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787383495.323860:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984961536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 156us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383495.323870:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787383495.323899:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984961536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383495.324032:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383495.324041:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984961408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787383495.324072:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787383495.324128:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984961408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383495.324135:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787383495.324208:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984961408:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787383495.324713:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383496.350477:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787383497.272166:0:19415:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787383497.272172:0:19415:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787383497.272174:0:19415:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787383497.272311:0:19415:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff963620417000 00000020:01000004:0.0:1787383497.272330:0:19415:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787383497.272348:0:19415:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787383497.272366:0:19415:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9636351b4d40) 00000020:00000080:0.0:1787383497.272387:0:19415:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787383497.312055:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787383497.313354:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787383497.314194:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787383497.314887:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787383497.315458:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787383497.315972:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787383497.316232:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1787383497.319566:0:19415:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787383497.319942:0:19415:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787383497.319966:0:19415:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787383497.319982:0:19415:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc40acec91532f88a 00000020:01000004:0.0:1787383497.319990:0:19415:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787383497.320017:0:19415:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787383497.320021:0:19415:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787383497.320027:0:19415:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787383497.320066:0:19415:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787383497.320071:0:19415:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787383497.338064:0:19415:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787383497.338121:0:19415:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.102@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787383497.338126:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787383497.338129:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787383497.338130:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383497.338131:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383497.338133:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383497.338134:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383497.338135:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383497.338137:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383497.338139:0:19415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787383497.338144:0:19415:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787383497.338146:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787383497.338147:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787383497.338148:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383497.338149:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383497.338151:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383497.338152:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383497.338153:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383497.338154:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383497.338155:0:19415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787383497.338188:0:19415:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787383497.338214:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984961664:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787383497.338411:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383497.338466:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff963601377480 going to sleep for 11 seconds 00000100:00100000:2.0:1787383497.338551:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984961664 00000100:00100000:2.0:1787383497.338831:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984961664 00000100:00100000:2.0:1787383497.338910:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787383497.338920:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:19415:x1874206984961664:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787383497.338960:0:17089:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787383497.338964:0:17089:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787383497.338970:0:17089:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787383497.339484:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:19415:x1874206984961664:12345-0@lo:253:mount.lustre.0 Request processed in 557us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383497.339495:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787383497.339901:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984961664:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787383497.339919:0:19415:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787383497.339923:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787383497.339925:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787383497.339926:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383497.339927:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383497.339928:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383497.339930:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383497.339931:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383497.339933:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383497.339935:0:19415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787383497.339967:0:19415:0:(tgt_mount.c:101:server_register_mount()) register mount ffff963620417000 from lustre-OST0001 10000000:01000000:1.0:1787383497.340008:0:19415:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787383497.340012:0:19415:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787383497.340024:0:19415:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9636352cb380 local copy 00010000:00010000:1.0:1787383497.340037:0:19415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383497.340164:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984961792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383497.340209:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383497.340309:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383497.340923:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984961792 00000100:00100000:2.0:1787383497.340936:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984961792 00000100:00100000:2.0:1787383497.340998:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787383497.341008:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:19415:x1874206984961792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383497.341179:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:19415:x1874206984961792:12345-0@lo:501:mount.lustre.0 Request processed in 172us (967us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383497.341187:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787383497.341266:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984961792:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787383497.341408:0:19415:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787383497.341438:0:19415:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787383497.341447:0:19415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383497.341458:0:19415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383497.341949:0:19415:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff963620417000 10000000:01000000:1.0:1787383497.341962:0:19415:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787383497.341970:0:19415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787383497.341973:0:19415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787383497.341978:0:19415:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787383497.341982:0:19415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787383497.342025:0:19415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383497.342035:0:19415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383497.342046:0:19415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383497.342071:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984961920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787383497.342124:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383497.342211:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383497.342251:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984961920 00000100:00100000:2.0:1787383497.342258:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984961920 00000100:00100000:2.0:1787383497.342408:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787383497.342418:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:19415:x1874206984961920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383497.342432:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383497.342449:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c9000/0xc40acec91532f898 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f891 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383497.342476:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9000/0xc40acec91532f898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f891 expref: 22 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383497.342499:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c9000/0xc40acec91532f898 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f891 expref: 22 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383497.342510:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9000, rc 0) 00000100:00100000:2.0:1787383497.342653:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:19415:x1874206984961920:12345-0@lo:101:mount.lustre.0 Request processed in 236us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383497.342661:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787383497.343044:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984961920:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383497.343063:0:19415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383497.343074:0:19415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383497.347930:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787383497.350238:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383497.360484:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787383497.360558:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787383497.360573:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787383497.360586:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787383497.360598:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787383497.360611:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787383497.360639:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787383497.360644:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787383497.361079:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383497.361611:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383497.361740:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787383497.361964:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984962048 00000100:00100000:2.0:1787383497.361975:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984962048 00000100:00100000:2.0:1787383497.362067:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787383497.362078:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:19415:x1874206984962048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383497.362412:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:19415:x1874206984962048:12345-0@lo:501:mount.lustre.0 Request processed in 333us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383497.362421:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787383497.362516:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962048:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383497.362569:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383497.362621:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383497.362807:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787383497.363035:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984962176 00000100:00100000:0.0:1787383497.363042:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984962176 00000100:00100000:0.0:1787383497.363072:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787383497.363079:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:19415:x1874206984962176:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383497.369595:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:19415:x1874206984962176:12345-0@lo:503:mount.lustre.0 Request processed in 6504us (6962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383497.369613:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787383497.369674:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962176:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787383497.370449:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787383497.370572:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383497.370668:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383497.370729:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383497.371127:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984962304 00000100:00100000:2.0:1787383497.371136:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984962304 00000100:00100000:2.0:1787383497.371216:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787383497.371227:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:19415:x1874206984962304:12345-0@lo:502:mount.lustre.0 00010000:00010000:0.0:1787383497.371655:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383497.371902:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:19415:x1874206984962304:12345-0@lo:502:mount.lustre.0 Request processed in 674us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383497.371913:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787383497.371994:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383497.372258:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787383497.372295:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787383497.372309:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787383497.372322:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787383497.372338:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787383497.372368:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787383497.372384:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787383497.372409:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787383497.372424:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787383497.372467:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383497.372526:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383497.372627:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383497.376509:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984962432 00000100:00100000:0.0:1787383497.376531:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984962432 00000100:00100000:0.0:1787383497.376723:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787383497.376737:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:19415:x1874206984962432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383497.377025:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:19415:x1874206984962432:12345-0@lo:502:mount.lustre.0 Request processed in 290us (4498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383497.377034:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787383497.377169:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962432:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787383497.377287:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787383497.377306:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1787383497.378205:0:19419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787383497.378216:0:19419:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1787383497.378224:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383497.378227:0:19419:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787383497.378235:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383497.378268:0:19419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff963504594d40) 00000020:00000080:2.0:1787383497.378301:0:19419:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787383497.378309:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787383497.378406:0:19419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963620417000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787383497.378416:0:19419:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787383497.378427:0:19419:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc40acec91532f8a6 00010000:00010000:2.0:1787383497.384457:0:19419:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1787383497.386129:0:19419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1787383497.392866:0:19419:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1787383497.394898:0:19419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787383497.394920:0:19419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383497.394929:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383497.394932:0:19419:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787383497.394936:0:19419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383497.394940:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383497.394942:0:19419:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787383497.394945:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787383497.394947:0:19419:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787383497.394949:0:19419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383497.394952:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383497.394953:0:19419:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787383497.394955:0:19419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383497.394957:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383497.394958:0:19419:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787383497.394961:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787383497.395001:0:19419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383497.395004:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383497.395006:0:19419:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787383497.395009:0:19419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787383497.395349:0:19415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787383497.395388:0:19415:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787383497.395416:0:19415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.395430:0:19415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383497.395439:0:19415:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff963620417000 from 1 10000000:01000000:3.0:1787383497.395442:0:19415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383497.395489:0:19415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.395497:0:19415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.395510:0:19415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383497.395542:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787383497.395651:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383497.395715:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787383497.395929:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984962560 00000100:00100000:1.0:1787383497.395941:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984962560 00000100:00100000:1.0:1787383497.396000:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787383497.396011:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:19415:x1874206984962560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383497.396027:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383497.396043:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96360516d600/0xc40acec91532f8b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f8ad expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383497.396072:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96360516d600/0xc40acec91532f8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f8ad expref: 23 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383497.396083:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96360516d600/0xc40acec91532f8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f8ad expref: 23 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383497.396093:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96360516d600, rc 0) 00000100:00100000:1.0:1787383497.396142:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:19415:x1874206984962560:12345-0@lo:101:mount.lustre.0 Request processed in 132us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383497.396151:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787383497.396259:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383497.396294:0:19415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f8b4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.396305:0:19415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f8b4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787383497.414717:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787383497.415384:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383497.415676:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787383497.415705:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787383497.415725:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787383497.415730:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787383497.416017:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383497.416108:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383497.416202:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383497.416342:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984962688 00000100:00100000:2.0:1787383497.416351:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984962688 00000100:00100000:2.0:1787383497.416464:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787383497.416476:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:19415:x1874206984962688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383497.416634:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:19415:x1874206984962688:12345-0@lo:501:mount.lustre.0 Request processed in 158us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383497.416642:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787383497.416726:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383497.416796:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383497.416846:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383497.419092:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383497.421545:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984962816 00000100:00100000:1.0:1787383497.421566:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984962816 00000100:00100000:1.0:1787383497.421645:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787383497.421658:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:19415:x1874206984962816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383497.422545:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:19415:x1874206984962816:12345-0@lo:503:mount.lustre.0 Request processed in 888us (5695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383497.422565:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787383497.423973:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962816:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787383497.424544:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787383497.424652:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383497.424744:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383497.424821:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787383497.424976:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984962944 00000100:00100000:1.0:1787383497.424984:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984962944 00000100:00100000:1.0:1787383497.425029:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787383497.425039:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:19415:x1874206984962944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383497.425166:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:19415:x1874206984962944:12345-0@lo:502:mount.lustre.0 Request processed in 127us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383497.425174:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787383497.425661:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984962944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787383497.426189:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787383497.426230:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787383497.426247:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787383497.426260:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787383497.426274:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787383497.426287:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787383497.426307:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787383497.426321:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787383497.426353:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787383497.426367:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787383497.426381:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787383497.426421:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383497.426489:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383497.426522:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787383497.426615:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984963072 00000100:00100000:1.0:1787383497.426622:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984963072 00000100:00100000:1.0:1787383497.426672:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787383497.426681:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:19415:x1874206984963072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383497.426831:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:19415:x1874206984963072:12345-0@lo:502:mount.lustre.0 Request processed in 149us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383497.426839:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787383497.429544:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787383497.429683:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787383497.429703:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787383497.435452:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383497.435471:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383497.435474:0:19423:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787383497.435483:0:19423:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff963620417000 00000020:00000080:0.0:1787383497.435487:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383497.435496:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383497.435499:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383497.435500:0:19423:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787383497.435503:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383497.435505:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383497.435506:0:19423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787383497.435509:0:19423:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff963620417000 00000020:00000080:0.0:1787383497.435511:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383497.435694:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383497.435699:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383497.435700:0:19423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787383497.435703:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383497.435705:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383497.435706:0:19423:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383497.435710:0:19423:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963620417000 00000020:00000080:0.0:1787383497.435712:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383497.446800:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383497.446844:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383497.446847:0:19423:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383497.446871:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383497.446876:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383497.446877:0:19423:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787383497.446883:0:19423:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963620417000 00000020:00000080:0.0:1787383497.446887:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383497.446965:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383497.446969:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383497.446971:0:19423:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787383497.446974:0:19423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787383497.447155:0:19415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787383497.447189:0:19415:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383497.447216:0:19415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f8b4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.447228:0:19415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f8b4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383497.447302:0:19415:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787383497.447305:0:19415:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff963620417000 10000000:01000000:0.0:1787383497.447309:0:19415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff963620417000 10000000:01000000:0.0:1787383497.447315:0:19415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383497.447322:0:19415:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff963620417000 from 1 10000000:01000000:0.0:1787383497.447325:0:19415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787383497.447365:0:19415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.447373:0:19415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.447384:0:19415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383497.447423:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383497.447628:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383497.447746:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984963200 00000100:00100000:0.0:1787383497.447754:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984963200 00000100:00100000:0.0:1787383497.447836:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787383497.447845:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:19415:x1874206984963200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383497.447858:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383497.447875:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963610f17a00/0xc40acec91532f8c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f8bb expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.447900:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963610f17a00/0xc40acec91532f8c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f8bb expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.447910:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963610f17a00/0xc40acec91532f8c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f8bb expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.447919:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17a00, rc 0) 00000100:00100000:0.0:1787383497.447950:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:19415:x1874206984963200:12345-0@lo:101:mount.lustre.0 Request processed in 106us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383497.447955:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787383497.447998:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383497.448019:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383497.448033:0:19415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.448042:0:19415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383497.451072:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1787383497.452139:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383497.452752:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787383497.452822:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787383497.452839:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787383497.452854:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787383497.452870:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787383497.452888:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787383497.452911:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787383497.453390:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787383497.453421:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787383497.453460:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787383497.453480:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787383497.453494:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787383497.453510:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787383497.453525:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787383497.453542:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787383497.453559:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787383497.453574:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787383497.453595:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787383497.453611:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787383497.453625:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787383497.453637:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787383497.453651:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787383497.453664:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787383497.453679:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787383497.454043:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787383497.454097:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787383497.454120:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787383497.454136:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787383497.454151:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787383497.454188:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787383497.454204:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787383497.454220:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787383497.454403:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787383497.454427:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787383497.454440:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787383497.454461:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787383497.454478:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787383497.454498:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787383497.454517:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1787383497.454535:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1787383497.454549:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1787383497.454589:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1787383497.454613:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1787383497.454627:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1787383497.454641:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1787383497.454655:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1787383497.454680:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1787383497.454687:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1787383497.464382:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383497.464461:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383497.464508:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787383497.465961:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984963328 00000100:00100000:3.0:1787383497.465980:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984963328 00000100:00100000:3.0:1787383497.466126:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787383497.466139:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:19415:x1874206984963328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383497.466380:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:19415:x1874206984963328:12345-0@lo:501:mount.lustre.0 Request processed in 244us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383497.466389:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787383497.466726:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383497.466853:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383497.466928:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383497.466955:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787383497.467099:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984963456 00000100:00100000:0.0:1787383497.467114:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984963456 00000100:00100000:0.0:1787383497.467187:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787383497.467199:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:19415:x1874206984963456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383497.468539:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:19415:x1874206984963456:12345-0@lo:503:mount.lustre.0 Request processed in 1339us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383497.468552:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787383497.468648:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963456:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787383497.469634:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383497.469730:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383497.472189:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383497.472243:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383497.473869:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984963584 00000100:00100000:2.0:1787383497.473882:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984963584 00000100:00100000:2.0:1787383497.473930:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787383497.473947:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:19415:x1874206984963584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383497.474089:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:19415:x1874206984963584:12345-0@lo:502:mount.lustre.0 Request processed in 143us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383497.474103:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787383497.475418:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383497.475658:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787383497.475693:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787383497.476036:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787383497.476059:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787383497.476073:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787383497.476086:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787383497.476099:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787383497.476113:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787383497.476127:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787383497.476142:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787383497.476172:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787383497.476188:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787383497.476200:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787383497.476212:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787383497.476225:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787383497.476238:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787383497.477143:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787383497.477190:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787383497.477206:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787383497.477220:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787383497.477234:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787383497.477247:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787383497.477911:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787383497.478043:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787383497.478064:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787383497.478078:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787383497.478110:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787383497.478126:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787383497.478152:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787383497.478166:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787383497.478178:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787383497.478191:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787383497.478203:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787383497.478217:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787383497.479122:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787383497.479143:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787383497.479157:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787383497.479172:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787383497.479186:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787383497.479200:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787383497.479214:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787383497.479228:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787383497.480149:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787383497.480184:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787383497.480199:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787383497.480211:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787383497.480224:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787383497.480239:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787383497.480304:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963712:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383497.480379:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383497.480498:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383497.480855:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984963712 00000100:00100000:1.0:1787383497.480863:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984963712 00000100:00100000:1.0:1787383497.480946:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787383497.480964:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:19415:x1874206984963712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383497.481103:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:19415:x1874206984963712:12345-0@lo:502:mount.lustre.0 Request processed in 140us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383497.481110:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787383497.481191:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963712:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383497.481396:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787383497.481424:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787383497.481449:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503fdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963840:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383497.481505:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383497.481545:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383497.481586:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984963840 00000100:00100000:1.0:1787383497.481591:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984963840 00000100:00100000:1.0:1787383497.481651:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787383497.481659:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:19415:x1874206984963840:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383497.481743:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:19415:x1874206984963840:12345-0@lo:502:mount.lustre.0 Request processed in 84us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383497.481750:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787383497.481887:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984963840:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383497.481930:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787383497.481939:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787383497.482364:0:19428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787383497.482378:0:19428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9636351b0000) 00000020:00000080:0.0:1787383497.482402:0:19428:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787383497.482651:0:19428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963620417000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787383497.482656:0:19428:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963620417000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787383497.482659:0:19428:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963620417000 3 00010000:00080000:0.0:1787383497.482692:0:19428:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963503eeb000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1787383497.484561:0:19428:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1787383497.484659:0:19428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787383497.484701:0:19428:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787383497.484713:0:19428:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc40acec91532f8d0 00000100:00080000:0.0:1787383497.484980:0:19428:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383497.484988:0:19428:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff963503eeb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383497.485118:0:19428:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362da0a300 x1874206984963968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383497.485173:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984963968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787383497.485245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787383497.485301:0:19428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787383497.485378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383497.485384:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383497.485387:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383497.485390:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787383497.485464:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984964352:0@lo:400:kworker.0 00000100:00100000:1.0:1787383497.485512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383497.485570:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984964352 00000100:00100000:0.0:1787383497.485577:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984964352 00000100:00100000:0.0:1787383497.485617:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787383497.485626:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984964352:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787383497.486658:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383497.486665:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787383497.486669:0:8:0:(import.c:65:import_set_state_nolock()) ffff9635036f7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383497.486675:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 527 00000100:00080000:3.0:1787383497.486680:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787383497.486686:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9635036f7800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383497.486698:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984964352:12345-0@lo:400:kworker.0 Request processed in 1070us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383497.486723:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9635045b4a80 x1874206984964608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383497.486802:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787383497.486839:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984964608:0@lo:8:kworker.0 00000100:00100000:0.0:1787383497.486879:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383497.486939:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984964608 00000100:00100000:0.0:1787383497.486951:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984964608 00000100:00100000:0.0:1787383497.486975:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383497.486980:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1874206984964608:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787383497.487035:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1874206984964608:12345-0@lo:8:kworker.0 Request processed in 53us (155us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787383497.487043:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383497.487076:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787383497.487082:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9635036f7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383497.487086:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787383497.487089:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984964608:0@lo:8:kworker.0 00000020:01000004:0.0:1787383497.487931:0:19428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787383497.487948:0:19428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9636351b19c0) 00000020:00000080:0.0:1787383497.487970:0:19428:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787383497.488169:0:19428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963620417000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787383497.488173:0:19428:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963620417000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787383497.488176:0:19428:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963620417000 3 00010000:00080000:0.0:1787383497.488206:0:19428:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9635035f9800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.102@tcp at head 00000100:00100000:1.0:1787383497.490042:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984964352:0@lo:400:kworker.0 00000100:00100000:1.0:1787383497.490081:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984964992:0@lo:400:kworker.0 00000100:00100000:1.0:1787383497.490143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383497.490182:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383497.490190:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984964480:0@lo:400:kworker.0 00000100:00100000:1.0:1787383497.490225:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383497.490240:0:19428:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1787383497.490339:0:19428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787383497.490384:0:19428:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787383497.490397:0:19428:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc40acec91532f8de 00000100:00080000:0.0:1787383497.490404:0:19428:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383497.490410:0:19428:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9635035f9800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383497.490440:0:19428:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f23b80 x1874206984965120/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383497.490473:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1874206984965120:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787383497.490520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787383497.490632:0:19428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787383497.490648:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984963968 00000100:00100000:3.0:1787383497.490655:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984963968 00000100:00100000:3.0:1787383497.490688:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984964992 00000100:00100000:3.0:1787383497.490691:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984964992 00000100:00100000:3.0:1787383497.490730:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984965120 00000100:00100000:3.0:1787383497.490733:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984965120 00000100:00100000:3.0:1787383497.490745:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787383497.490754:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984964992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383497.491860:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383497.491870:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1874206984963968:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787383497.491878:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984964992:12345-0@lo:400:kworker.0 Request processed in 1123us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383497.491888:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787383497.491897:0:17096:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000100:00100000:3.0:1787383497.491912:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383497.491918:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1874206984965120:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787383497.491936:0:17095:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:0.0:1787383497.491948:0:17096:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc40acec91532f8e5 00000004:00100000:0.0:1787383497.491966:0:17096:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:3.0:1787383497.491967:0:17095:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc40acec91532f8ec 00000004:00100000:3.0:1787383497.491979:0:17095:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787383497.492003:0:17096:0:(import.c:65:import_set_state_nolock()) ffff9635035f8000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787383497.492005:0:17095:0:(import.c:65:import_set_state_nolock()) ffff96363f99b000 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1787383497.492128:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9635045b6d80 x1874206984964992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383497.492142:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984964992:0@lo:400:kworker.0 00000100:00100000:3.0:1787383497.493088:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874206984965120:12345-0@lo:38:llog_process_th.0 Request processed in 1162us (2561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383497.493088:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874206984963968:12345-0@lo:38:llog_process_th.0 Request processed in 1213us (7838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383497.493098:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383497.493108:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787383497.493137:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383497.493142:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383497.493145:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383497.493149:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1787383497.493166:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963503f23b80 x1874206984965120/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383497.493176:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787383497.493184:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787383497.493192:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787383497.493197:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787383497.493199:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9635035f9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787383497.493206:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1874206984965120:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787383497.493221:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362da0a300 x1874206984963968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383497.493228:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787383497.493232:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787383497.493235:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787383497.493238:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787383497.493239:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963503eeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787383497.493252:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984963968:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787383497.493376:0:19428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1787383497.493429:0:19415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787383497.493462:0:19415:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787383497.493479:0:19415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.493489:0:19415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787383497.493532:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787383497.493534:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787383497.493536:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383497.493537:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383497.493538:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383497.493540:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383497.493541:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383497.493543:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383497.493545:0:19415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787383497.493548:0:19415:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787383497.493551:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787383497.493552:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787383497.493553:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383497.493554:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383497.493555:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383497.493556:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383497.493557:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383497.493558:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383497.493559:0:19415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787383497.493579:0:19415:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787383497.493595:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984965248:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787383497.493648:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383497.493678:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383497.493695:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984965248 00000100:00100000:0.0:1787383497.493705:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984965248 00000100:00100000:0.0:1787383497.493755:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787383497.493761:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:19415:x1874206984965248:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787383497.493815:0:17089:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787383497.493829:0:17089:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787383497.493843:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984964224:0@lo:400:kworker.0 00000100:00100000:3.0:1787383497.493876:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383497.493896:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984964864:0@lo:400:kworker.0 00000100:00100000:3.0:1787383497.493918:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383497.493938:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787383497.493938:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984964224 00000100:00100000:0.0:1787383497.493943:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984964224 00000100:00100000:3.0:1787383497.493947:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984964096:0@lo:400:kworker.0 00000100:00100000:0.0:1787383497.493973:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984964864 00000100:00100000:3.0:1787383497.493975:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383497.493979:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984964864 00000100:00100000:3.0:1787383497.493999:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984964736:0@lo:400:kworker.0 00000100:00100000:0.0:1787383497.494004:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787383497.494012:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984964224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383497.494026:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383497.494055:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984964736 00000100:00100000:3.0:1787383497.494060:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984964736 00000100:00100000:0.0:1787383497.494063:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984964224:12345-0@lo:400:kworker.0 Request processed in 51us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383497.494070:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787383497.494086:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787383497.494092:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787383497.494096:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984964864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383497.494105:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984964736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383497.494137:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874206984964864:12345-0@lo:400:kworker.0 Request processed in 44us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383497.494144:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787383497.494149:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984964736:12345-0@lo:400:kworker.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383497.494158:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787383497.494169:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984964096 00000100:00100000:3.0:1787383497.494173:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984964096 00010000:00080000:0.0:1787383497.494190:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9635045b5f80 x1874206984964736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383497.494199:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984964736:0@lo:400:kworker.0 00000100:00100000:3.0:1787383497.494203:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787383497.494210:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9635045b7b80 x1874206984964224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383497.494217:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984964224:0@lo:400:kworker.0 00000100:00100000:3.0:1787383497.494222:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984964096:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787383497.494227:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9635045b7480 x1874206984964864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383497.494239:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1874206984964864:0@lo:400:kworker.0 00000100:00100000:0.0:1787383497.494265:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984964096:0@lo:400:kworker.0 00000100:00100000:3.0:1787383497.494266:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984964096:12345-0@lo:400:kworker.0 Request processed in 47us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383497.494274:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787383497.495274:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383497.495281:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383497.495300:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984964480 00000100:00100000:0.0:1787383497.495305:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984964480 00000100:00100000:0.0:1787383497.495351:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383497.495360:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984964480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383497.495417:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984964480:12345-0@lo:400:kworker.0 Request processed in 59us (5193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383497.495425:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787383497.495585:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9635045b7100 x1874206984964480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383497.495599:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984964480:0@lo:400:kworker.0 00000100:00080000:0.0:1787383497.495624:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 20000000:01000000:2.0:1787383497.503311:0:17089:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787383497.503329:0:17089:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787383497.503355:0:17110:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787383497.503361:0:17110:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787383497.503385:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.503404:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c8400/0xc40acec91532f867 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f860 expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.503414:0:17110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c9200/0xc40acec91532f875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f86e expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.503421:0:17110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.503464:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c9200/0xc40acec91532f875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532f86e expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.503476:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636113c9200/0xc40acec91532f875 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532f86e expref: 24 pid: 17088 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383497.503489:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984965376:0@lo:104: 00000100:00100000:0.0:1787383497.503548:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383497.503601:0:17110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c8400/0xc40acec91532f867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532f860 expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383497.503608:0:17110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636113c8400/0xc40acec91532f867 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532f860 expref: 24 pid: 17088 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383497.503615:0:17110:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984965504:0@lo:104: 00000100:00100000:0.0:1787383497.503635:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383497.503648:0:17110:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636054f1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787383497.505737:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984965376 00000100:00100000:2.0:1787383497.505751:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984965376 00000100:00100000:2.0:1787383497.505819:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984965504 00000100:00100000:2.0:1787383497.505823:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984965504 00000100:00100000:2.0:1787383497.505854:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383497.505864:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+4:17110:x1874206984965376:12345-0@lo:104: 00010000:00010000:2.0:1787383497.505881:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f875 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383497.505905:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:19415:x1874206984965248:12345-0@lo:253:mount.lustre.0 Request processed in 12140us (12254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383497.505916:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00010000:2.0:1787383497.505946:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787383497.505954:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+4:17110:x1874206984965376:12345-0@lo:104: Request processed in 93us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383497.505961:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383497.505976:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383497.505983:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:17110:x1874206984965504:12345-0@lo:104: 00010000:00010000:2.0:1787383497.505991:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f867 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383497.506026:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787383497.506031:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:17110:x1874206984965504:12345-0@lo:104: Request processed in 50us (2396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383497.506037:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787383497.506063:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:98408fb2-7fed-492b-911f-46eabbf1f8e3:19415:1874206984965248:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787383497.506077:0:19415:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787383497.506080:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787383497.506082:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787383497.506083:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383497.506084:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383497.506085:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383497.506086:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383497.506088:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383497.506089:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383497.506091:0:19415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787383497.506105:0:19415:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787383497.509824:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383497.509835:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f875 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.509847:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383497.509851:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532f875 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.509861:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532f875 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383497.509868:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532f875 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383497.509874:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787383497.509919:0:17082:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f875 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.509926:0:17082:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383497.509949:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f875 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.509955:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f86e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f875 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.509977:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383497.509980:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f867 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.509986:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383497.509988:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532f867 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.509995:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532f867 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383497.510001:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532f867 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383497.510006:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787383497.510019:0:17082:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f867 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.510024:0:17082:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383497.510039:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f867 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.510046:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c9e00/0xc40acec91532f860 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f867 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.510059:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383497.510061:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383497.510062:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383497.510081:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984965632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383497.510150:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383497.510201:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984965760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383497.510224:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383497.510267:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984965376:0@lo:104: 00000100:00100000:3.0:1787383497.510277:0:17110:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17110:1874206984965504:0@lo:104: 00010000:00010000:3.0:1787383497.510296:0:17110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383497.513855:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984965632 00000100:00100000:3.0:1787383497.513868:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984965632 00010000:00010000:3.0:1787383497.513912:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c9200/0xc40acec91532f875 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f86e expref: 24 pid: 17088 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383497.513947:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984965760 00000100:00100000:3.0:1787383497.513951:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984965760 00010000:00010000:3.0:1787383497.513984:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c8400/0xc40acec91532f867 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f860 expref: 25 pid: 17088 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383497.514000:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383497.514008:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+25:3648:x1874206984965632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383497.514021:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383497.514026:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c9200/0xc40acec91532f875 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f86e expref: 25 pid: 17088 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514038:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c9200/0xc40acec91532f875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532f86e expref: 25 pid: 17088 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514056:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9200/0xc40acec91532f875 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532f86e expref: 25 pid: 17088 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514081:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383497.514154:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3648:x1874206984965632:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (4003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383497.514162:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383497.514183:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383497.514191:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:3649:x1874206984965760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383497.514208:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383497.514213:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c8400/0xc40acec91532f867 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f860 expref: 23 pid: 17088 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514224:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c8400/0xc40acec91532f867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532f860 expref: 23 pid: 17088 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514235:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c8400/0xc40acec91532f867 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532f860 expref: 23 pid: 17088 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514247:0:17080:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514255:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787383497.514268:0:17080:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011472102s 00010000:00010000:3.0:1787383497.514272:0:17080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514279:0:17080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514294:0:17080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514300:0:17080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514305:0:17080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383497.514309:0:17080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514316:0:17080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514345:0:17080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514356:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383497.514381:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:3649:x1874206984965760:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (4156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383497.514387:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1787383497.514404:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383497.514509:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984965760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383497.514539:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984965632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383497.514555:0:17110:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514563:0:17110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383497.514579:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963610f17200/0xc40acec91532f8f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1787383497.527700:0:19415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787383497.536660:0:19415:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787383497.536685:0:19415:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787383497.536730:0:19415:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787383497.536976:0:19415:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787383497.536998:0:19415:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787383497.537016:0:19415:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787383497.538003:0:19415:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383497.538244:0:19415:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787383498.397377:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787383498.549217:0:19482:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383498.549516:0:19482:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1787383498.788182:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787383499.423608:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383499.424224:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984965888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383499.424336:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383499.427053:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984965888 00000100:00100000:2.0:1787383499.427077:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984965888 00000100:00100000:2.0:1787383499.427168:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383499.427192:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984965888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787383499.427239:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787383499.427360:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984965888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 171us (3024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383499.427368:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787383499.427546:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787383499.428296:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362da09180 x1874206984965888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383499.428340:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984965888:0@lo:13:osp-pre-0-1.0 10000000:01000000:0.0:1787383499.552044:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787383499.552057:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff963636f5c800 from 10 10000000:01000000:0.0:1787383499.552065:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787383499.552135:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383499.552151:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383499.552164:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383499.552200:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984966016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383499.552305:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383499.554045:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363530d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787383499.557192:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984966016 00000100:00100000:2.0:1787383499.557216:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984966016 00000100:00100000:3.0:1787383499.560381:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787383499.560403:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:17091:x1874206984966016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383499.560429:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383499.560458:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963600030200/0xc40acec91532f901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f8fa expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383499.560495:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963600030200/0xc40acec91532f901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f8fa expref: 23 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383499.560511:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963600030200/0xc40acec91532f901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f8fa expref: 23 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383499.560522:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030200, rc 0) 00000100:00100000:3.0:1787383499.560644:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:17091:x1874206984966016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (8339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383499.560652:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787383499.561851:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984966016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383499.561886:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383499.561900:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383499.563002:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984966144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787383499.563085:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383499.563135:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363530d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787383499.563262:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984966144 00000100:00100000:3.0:1787383499.563271:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984966144 00000100:00100000:3.0:1787383499.563332:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787383499.563343:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:17091:x1874206984966144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787383499.563368:0:17089:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787383499.563391:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787383499.563398:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787383499.563605:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:17091:x1874206984966144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 263us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383499.563614:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787383499.565221:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984966144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787383499.565324:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787383499.565338:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383499.565351:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383499.565364:0:17091:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787383499.565368:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff963620e92000 from 10 10000000:01000000:2.0:1787383499.565371:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787383499.565420:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383499.565446:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383499.565457:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383499.565481:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984966272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383499.565552:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383499.565656:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635046b93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383499.565973:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984966272 00000100:00100000:3.0:1787383499.565981:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984966272 00000100:00100000:3.0:1787383499.566083:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787383499.566092:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:17091:x1874206984966272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383499.566108:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383499.566127:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963600030000/0xc40acec91532f90f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532f908 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383499.566154:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963600030000/0xc40acec91532f90f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532f908 expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383499.566166:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963600030000/0xc40acec91532f90f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f908 expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383499.566178:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030000, rc 0) 00000100:00100000:3.0:1787383499.566238:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:17091:x1874206984966272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383499.566245:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787383499.566326:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984966272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383499.566342:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383499.566352:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383499.566413:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984966400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787383499.566448:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383499.566519:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635046b93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383499.566558:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984966400 00000100:00100000:0.0:1787383499.566563:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984966400 00000100:00100000:0.0:1787383499.566588:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787383499.566594:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:17091:x1874206984966400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787383499.566617:0:17086:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787383499.566637:0:17086:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787383499.566640:0:17086:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787383499.566734:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:17091:x1874206984966400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383499.566742:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787383499.566920:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984966400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787383499.566979:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787383499.566987:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383499.566996:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383500.445160:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984966528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383500.445255:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383500.445321:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984966528 00000100:00100000:0.0:1787383500.445331:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984966528 00000100:00100000:0.0:1787383500.445383:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787383500.445392:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984966528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383500.445435:0:17835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787383500.445482:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984966528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383500.445489:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787383500.445541:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984966528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383500.445708:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984966656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383500.445736:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383500.445841:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984966656 00000100:00100000:3.0:1787383500.445847:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984966656 00000100:00100000:3.0:1787383500.445881:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787383500.445888:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984966656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787383500.445910:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787383500.445948:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984966656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383500.445977:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787383500.446054:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984966656:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787383500.460206:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787383501.214849:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787383501.472342:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383502.496248:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383502.618957:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383482/real 1787383482] req@ffff963503fd9500 x1874206984953856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383502 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383502.618993:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503fd9500 x1874206984953856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383502 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383502.619004:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383482/real 1787383482] req@ffff963503fd9180 x1874206984953344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383502 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383502.619015:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503fd9180 x1874206984953344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383502 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787383502.619035:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963635dfd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383502.619065:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787383502.619069:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984953856:0@lo:8:kworker.0 00000100:00080000:2.0:1787383502.619075:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363d874000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383502.619084:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787383502.619087:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984953344:0@lo:8:kworker.0 00000100:00080000:3.0:1787383502.619236:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383502.619240:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787383502.619243:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96363d874000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383502.619248:0:13975:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:3.0:1787383502.619253:0:13975:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787383502.619258:0:13975:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96363d874000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383502.619274:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9635045b7b80 x1874206984967040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787383502.619287:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383502.619290:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787383502.619292:0:13975:0:(import.c:65:import_set_state_nolock()) ffff963635dfd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383502.619294:0:13975:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:3.0:1787383502.619296:0:13975:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787383502.619299:0:13975:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff963635dfd800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383502.619307:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9635045b5f80 x1874206984967168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787383502.619336:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383502.619338:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787383502.619340:0:13975:0:(import.c:65:import_set_state_nolock()) ffff9635036f7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383502.619344:0:13975:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9635036f7800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383502.619351:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9635045b4000 x1874206984967680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787383502.619416:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984966912:0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.619472:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383502.619504:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984967808:0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.619523:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383502.619535:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984968320:0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.619557:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383502.619576:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787383502.619581:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984966784:0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.619608:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383502.619630:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984967552:0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.619652:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383502.619669:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984968192:0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.619688:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383502.619850:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984967296:0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.619872:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383502.619885:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984967936:0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.619900:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383502.619908:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787383502.619913:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984967424:0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.619929:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383502.619941:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984968064:0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.619955:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383502.619974:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984966912 00000100:00100000:3.0:1787383502.619985:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984966912 00000100:00100000:3.0:1787383502.620019:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984967424 00000100:00100000:3.0:1787383502.620021:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984967424 00000100:00100000:3.0:1787383502.620033:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383502.620040:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984966912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.620083:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984966912:12345-0@lo:400:kworker.0 Request processed in 44us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383502.620090:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383502.620105:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787383502.620111:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984967424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.620140:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984967424:12345-0@lo:400:kworker.0 Request processed in 29us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383502.620145:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787383502.620163:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984967808 00000100:00100000:3.0:1787383502.620166:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984967808 00000100:00100000:3.0:1787383502.620183:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984968320 00000100:00100000:3.0:1787383502.620185:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984968320 00000100:00100000:3.0:1787383502.620205:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984968192 00000100:00100000:3.0:1787383502.620208:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984968192 00000100:00100000:3.0:1787383502.620218:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984967296 00000100:00100000:3.0:1787383502.620221:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984967296 00000100:00100000:3.0:1787383502.620228:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984967936 00000100:00100000:3.0:1787383502.620230:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984967936 00000100:00100000:3.0:1787383502.620239:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984968064 00000100:00100000:3.0:1787383502.620241:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984968064 00000100:00100000:3.0:1787383502.620254:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787383502.620259:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984967808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.620286:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984967808:12345-0@lo:400:kworker.0 Request processed in 27us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383502.620291:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787383502.620309:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787383502.620314:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984968320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.620340:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984968320:12345-0@lo:400:kworker.0 Request processed in 26us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383502.620345:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787383502.620355:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787383502.620361:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984968192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.620383:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984968192:12345-0@lo:400:kworker.0 Request processed in 23us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383502.620388:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787383502.620397:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787383502.620401:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984967296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.620424:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984967296:12345-0@lo:400:kworker.0 Request processed in 22us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383502.620429:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787383502.620439:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383502.620444:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984967936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.620470:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984967936:12345-0@lo:400:kworker.0 Request processed in 25us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383502.620475:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383502.620485:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383502.620491:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984968064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.620516:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984968064:12345-0@lo:400:kworker.0 Request processed in 25us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383502.620522:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383502.620551:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984966784 00000100:00100000:3.0:1787383502.620555:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984966784 00000100:00100000:3.0:1787383502.620579:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787383502.620586:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3650:x1874206984966784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.620616:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3650:x1874206984966784:12345-0@lo:400:kworker.0 Request processed in 30us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383502.620621:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787383502.620648:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984967552 00000100:00100000:3.0:1787383502.620651:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984967552 00000100:00100000:3.0:1787383502.620678:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383502.620683:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984967552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383502.620897:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984967040:0@lo:8:kworker.0 00000100:00100000:2.0:1787383502.620932:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383502.620962:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984967168:0@lo:8:kworker.0 00000100:00100000:2.0:1787383502.620982:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383502.620995:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984967680:0@lo:8:kworker.0 00000100:00100000:2.0:1787383502.621019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383502.621041:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984967040 00000100:00100000:2.0:1787383502.621050:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984967040 00000100:00100000:2.0:1787383502.621063:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984967168 00000100:00100000:2.0:1787383502.621065:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984967168 00000100:00100000:2.0:1787383502.621071:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984967680 00000100:00100000:2.0:1787383502.621073:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984967680 00000100:00100000:2.0:1787383502.621081:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787383502.621085:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1874206984967040:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787383502.621109:0:18600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:2.0:1787383502.621140:0:18600:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532f916 00002000:00100000:2.0:1787383502.621156:0:18600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96350453f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787383502.621160:0:18600:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787383502.621163:0:18600:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787383502.621245:0:18600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787383502.621269:0:18600:0:(import.c:65:import_set_state_nolock()) ffff96350453e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383502.621308:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874206984967040:12345-0@lo:8:kworker.0 Request processed in 221us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383502.621315:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787383502.621329:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383502.621333:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1874206984967168:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787383502.621348:0:18600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:2.0:1787383502.621364:0:18600:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532f91d 00002000:00100000:2.0:1787383502.621371:0:18600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96350453b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787383502.621374:0:18600:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787383502.621376:0:18600:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787383502.621500:0:18600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787383502.621513:0:18600:0:(import.c:65:import_set_state_nolock()) ffff96350453a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383502.621541:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874206984967168:12345-0@lo:8:kworker.0 Request processed in 205us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383502.621552:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383502.621565:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383502.621568:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1874206984967680:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787383502.621583:0:18600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:2.0:1787383502.621598:0:18600:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532f924 00002000:00100000:2.0:1787383502.621605:0:18600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff963504539800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787383502.621607:0:18600:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787383502.621609:0:18600:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787383502.621630:0:18600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787383502.621641:0:18600:0:(import.c:65:import_set_state_nolock()) ffff963504538800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383502.621668:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1874206984967680:12345-0@lo:8:kworker.0 Request processed in 98us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383502.621674:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383502.621754:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984966784:0@lo:400:kworker.0 00010000:00080000:2.0:1787383502.621798:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f6b480 x1874206984968192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383502.621809:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984968192:0@lo:400:kworker.0 00000100:00100000:2.0:1787383502.621822:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984966912:0@lo:400:kworker.0 00010000:00080000:2.0:1787383502.621833:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635045b6680 x1874206984967808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383502.621840:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984967808:0@lo:400:kworker.0 00010000:00080000:2.0:1787383502.621853:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f69180 x1874206984968320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383502.621872:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984968320:0@lo:400:kworker.0 00010000:00080000:2.0:1787383502.621912:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635045b7b80 x1874206984967040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383502.621919:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787383502.621925:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787383502.621932:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787383502.621936:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787383502.621938:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363d874000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787383502.621964:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787383502.621969:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984967040:0@lo:8:kworker.0 00010000:00080000:2.0:1787383502.621981:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635045b5f80 x1874206984967168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383502.621988:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787383502.621991:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787383502.621995:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787383502.621998:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787383502.622000:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963635dfd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787383502.622018:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787383502.622021:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984967168:0@lo:8:kworker.0 00010000:00080000:2.0:1787383502.622033:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635045b4000 x1874206984967680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787383502.622041:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1787383502.622044:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787383502.622047:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787383502.622055:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9635036f7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787383502.622068:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787383502.622073:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984967680:0@lo:8:kworker.0 00000100:00100000:3.0:1787383502.622371:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984967552:12345-0@lo:400:kworker.0 Request processed in 1685us (2715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383502.622378:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787383502.622399:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383502.622404:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383502.622406:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787383502.622422:0:17118:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787383502.622484:0:17118:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 535650717669ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787383502.622491:0:17118:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787383502.622541:0:17839:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787383502.622560:0:17839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17839:1874206984968576:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787383502.622587:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383502.622606:0:17839:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636187db240 going to sleep for 11 seconds 00000004:00080000:3.0:1787383502.622632:0:17838:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787383502.622672:0:17838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 535650906191ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787383502.622677:0:17838:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787383502.623089:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383502.623105:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984968448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383502.623134:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383502.623167:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984968448 00000100:00100000:3.0:1787383502.623173:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984968448 00000100:00100000:3.0:1787383502.623212:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787383502.623219:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874206984968448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383502.623242:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787383502.623275:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1874206984968448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383502.623282:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787383502.623294:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787383502.623314:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447d500 x1874206984968448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383502.623328:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984968448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383502.623352:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984967424:0@lo:400:kworker.0 00010000:00080000:3.0:1787383502.623362:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f69500 x1874206984968064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383502.623370:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984968064:0@lo:400:kworker.0 00010000:00080000:3.0:1787383502.623381:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635045b6d80 x1874206984967296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383502.623387:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984967296:0@lo:400:kworker.0 00010000:00080000:3.0:1787383502.623398:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f6a680 x1874206984967936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383502.623405:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984967936:0@lo:400:kworker.0 00000100:00100000:3.0:1787383502.623432:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984968576 00000100:00100000:3.0:1787383502.623435:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984968576 00000100:00100000:3.0:1787383502.623456:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383502.623461:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17839:x1874206984968576:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787383502.625121:0:17121:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1787383502.625145:0:17121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17121:1874206984968832:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787383502.625206:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383502.625231:0:17121:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363530d0c0 going to sleep for 11 seconds 00000004:00080000:0.0:1787383502.625260:0:17120:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787383502.625339:0:17120:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 535653572087ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787383502.625345:0:17120:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1787383502.625937:0:17119:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1787383502.625958:0:17119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17119:1874206984969088:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787383502.625994:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383502.626012:0:17119:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360395d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383502.627893:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984968832 00000100:00100000:3.0:1787383502.627906:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984968832 00000100:00100000:3.0:1787383502.627962:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984969088 00000100:00100000:3.0:1787383502.627965:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984969088 00000100:00100000:3.0:1787383502.627987:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383502.627995:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17121:x1874206984968832:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1787383502.628178:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383502.628182:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787383502.630113:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9635045b4a80 x1874206984967552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383502.630131:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984967552:0@lo:400:kworker.0 00000100:00100000:2.0:1787383502.630156:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383502.630175:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984968960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383502.630231:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383502.632030:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984968704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383502.632131:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1787383502.641307:0:18600:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787383502.641316:0:18600:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787383502.641405:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17839:x1874206984968576:12345-0@lo:7:osp-pre-1-1.0 Request processed in 17940us (18813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383502.641416:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787383502.641450:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383502.641461:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17119:x1874206984969088:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787383502.643971:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984968960 00000100:00100000:0.0:1787383502.643984:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984968960 00000100:00100000:0.0:1787383502.644039:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984968704 00000100:00100000:0.0:1787383502.644043:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984968704 00000100:00100000:0.0:1787383502.644060:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383502.644069:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874206984968960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383502.644101:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787383502.644176:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874206984968960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (13943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383502.644185:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383502.644206:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787383502.644215:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1874206984968704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383502.644228:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00010000:00080000:3.0:1787383502.644241:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362da09180 x1874206984968960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383502.644266:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984968960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383502.644352:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1874206984968704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (12220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383502.644359:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787383502.644869:0:17839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447fb80 x1874206984968576/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787383518 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383502.644883:0:17839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17839:1874206984968576:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1787383502.644896:0:17839:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787383502.644930:0:17839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17839:1874206984969216:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787383502.644965:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383502.644986:0:17839:0:(client.c:2702:ptlrpc_set_wait()) set ffff963604a92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383502.645481:0:18599:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787383502.645489:0:18599:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00080000:3.0:1787383502.646963:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f20e00 x1874206984968704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383502.646991:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984968704:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1787383502.647101:0:18602:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787383502.647109:0:18602:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787383502.647114:0:18602:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000100:00100000:2.0:1787383502.649904:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984969216 00000100:00100000:2.0:1787383502.649917:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984969216 00000100:00100000:2.0:1787383502.650060:0:19676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383502.650070:0:19676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17839:x1874206984969216:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787383502.650100:0:19676:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787383502.650177:0:19676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17839:x1874206984969216:12345-0@lo:5:osp-pre-1-1.0 Request processed in 108us (5211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383502.650184:0:19676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787383502.650227:0:17839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447a300 x1874206984969216/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383518 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383502.650241:0:17839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17839:1874206984969216:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787383502.650254:0:17839:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787383502.650294:0:17839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17839:1874206984969344:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787383502.650324:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383502.650345:0:17839:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350337e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383502.650356:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984969344 00000100:00100000:2.0:1787383502.650360:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984969344 00000100:00100000:2.0:1787383502.650380:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383502.650387:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17839:x1874206984969344:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787383502.650411:0:18599:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000004:00080000:3.0:1787383502.653441:0:17827:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1787383502.656166:0:17074:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1787383502.667589:0:18600:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787383502.667599:0:18600:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787383502.667606:0:18600:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:0.0:1787383502.668942:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.668955:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d31c7c2/0xc40acec91532f92b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.668973:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.668977:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.668993:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d31c7c2/0xc40acec91532f92b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.669011:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d31c7c2/0xc40acec91532f92b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.669021:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d31c7c2/0xc40acec91532f92b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.669028:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d31c7c2/0xc40acec91532f92b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.669047:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383502.669058:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383502.669063:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d31c7c2/0xc40acec91532f92b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.669072:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383502.669076:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d31c7c2/0xc40acec91532f92b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.669086:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d31c7c2/0xc40acec91532f92b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.669102:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d31c7c2/0xc40acec91532f92b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.669121:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d31c7c2/0xc40acec91532f92b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.669139:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.669141:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.669142:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787383502.670864:0:17074:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787383502.674242:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.674256:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e2b81d6/0xc40acec91532f932 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.674272:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.674277:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.674282:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e2b81d6/0xc40acec91532f932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.674298:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e2b81d6/0xc40acec91532f932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.674308:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e2b81d6/0xc40acec91532f932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.674323:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e2b81d6/0xc40acec91532f932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.674351:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787383502.683024:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383502.683038:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091dde0f7/0xc40acec91532f939 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683066:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1787383502.683070:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383502.683076:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091dde0f7/0xc40acec91532f939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683091:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091dde0f7/0xc40acec91532f939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683100:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091dde0f7/0xc40acec91532f939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683108:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091dde0f7/0xc40acec91532f939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683127:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787383502.683271:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383502.683278:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e2b81d6/0xc40acec91532f932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683286:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383502.683291:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e2b81d6/0xc40acec91532f932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683300:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e2b81d6/0xc40acec91532f932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683326:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e2b81d6/0xc40acec91532f932 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683334:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e2b81d6/0xc40acec91532f932 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683350:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383502.683354:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091dde0f7/0xc40acec91532f939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683360:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383502.683364:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091dde0f7/0xc40acec91532f939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683371:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091dde0f7/0xc40acec91532f939 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683380:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091dde0f7/0xc40acec91532f939 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683387:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091dde0f7/0xc40acec91532f939 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.683400:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383502.683402:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383502.683409:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383502.684923:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383502.684934:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532f940 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.684947:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1787383502.684950:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383502.684956:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532f940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.684967:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532f940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.684974:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532f940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.684981:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532f940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.685004:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383502.685258:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383502.685265:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532f940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.685274:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383502.685278:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532f940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.685287:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532f940 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.685303:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532f940 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.685310:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fb338fb/0xc40acec91532f940 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.685329:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.685331:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.685333:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383502.689585:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383502.689600:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532f947 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.689617:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1787383502.689622:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383502.689628:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532f947 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.689656:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532f947 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.689666:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532f947 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.689687:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532f947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.689713:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383502.689937:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383502.689943:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532f947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.689952:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383502.689956:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532f947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.689964:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532f947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.689980:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532f947 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.689989:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c9f22fc/0xc40acec91532f947 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.690014:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383502.690015:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383502.690017:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383502.690307:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383502.690314:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c754ff4/0xc40acec91532f94e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.690323:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1787383502.690327:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383502.690331:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c754ff4/0xc40acec91532f94e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.690341:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c754ff4/0xc40acec91532f94e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.690350:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c754ff4/0xc40acec91532f94e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.690357:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c754ff4/0xc40acec91532f94e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.690390:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787383502.690647:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383502.690653:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000191b39b6/0xc40acec91532f955 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.691832:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1787383502.691840:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383502.691846:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000191b39b6/0xc40acec91532f955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.691859:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000191b39b6/0xc40acec91532f955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.691869:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000191b39b6/0xc40acec91532f955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.691877:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000191b39b6/0xc40acec91532f955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.691895:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787383502.692042:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383502.692048:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c754ff4/0xc40acec91532f94e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.692056:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383502.692060:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c754ff4/0xc40acec91532f94e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.692069:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c754ff4/0xc40acec91532f94e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.692096:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c754ff4/0xc40acec91532f94e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.692102:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c754ff4/0xc40acec91532f94e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.692120:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383502.692124:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000191b39b6/0xc40acec91532f955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.692130:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600031400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383502.692133:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000191b39b6/0xc40acec91532f955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.692140:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000191b39b6/0xc40acec91532f955 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.692148:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000191b39b6/0xc40acec91532f955 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.692154:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000191b39b6/0xc40acec91532f955 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.692164:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383502.692165:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383502.692172:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.692232:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383502.693931:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383502.693943:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000330ac750/0xc40acec91532f95c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.693962:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1787383502.693966:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383502.693971:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000330ac750/0xc40acec91532f95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.693983:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000330ac750/0xc40acec91532f95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.693993:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000330ac750/0xc40acec91532f95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.694001:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000330ac750/0xc40acec91532f95c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.694017:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383502.694167:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383502.694173:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000330ac750/0xc40acec91532f95c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.694182:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96360516ca00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383502.694186:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000330ac750/0xc40acec91532f95c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.694206:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000330ac750/0xc40acec91532f95c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.694221:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000330ac750/0xc40acec91532f95c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.694229:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000330ac750/0xc40acec91532f95c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.694247:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383502.694248:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383502.694250:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.694423:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383502.699095:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.699110:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec91532f963 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.699135:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.699140:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.699147:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec91532f963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.699164:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec91532f963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.699175:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec91532f963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.699184:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec91532f963 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.699220:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787383502.700462:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.700472:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532f96a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.700486:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.700490:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.700495:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532f96a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.700508:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532f96a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.700528:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532f96a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.700535:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532f96a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.700557:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787383502.701029:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.701036:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f3951b8/0xc40acec91532f971 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701046:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.701049:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.701054:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f3951b8/0xc40acec91532f971 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701063:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f3951b8/0xc40acec91532f971 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701071:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f3951b8/0xc40acec91532f971 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701078:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f3951b8/0xc40acec91532f971 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701104:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787383502.701195:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787383502.701202:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec91532f963 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701210:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.701215:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec91532f963 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701224:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec91532f963 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701241:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec91532f963 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701249:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec91532f963 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701269:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383502.701272:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532f96a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701277:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.701280:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532f96a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701299:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532f96a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701311:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532f96a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701318:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eb2abb9/0xc40acec91532f96a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701330:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383502.701333:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f3951b8/0xc40acec91532f971 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701340:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.701343:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f3951b8/0xc40acec91532f971 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701350:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f3951b8/0xc40acec91532f971 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701359:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f3951b8/0xc40acec91532f971 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701367:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f3951b8/0xc40acec91532f971 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701390:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.701391:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.701393:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383502.701435:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.701441:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91532f978 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701449:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.701452:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.701457:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91532f978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701466:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91532f978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701473:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91532f978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701481:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91532f978 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701493:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383502.701500:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383502.701503:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91532f978 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701521:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8a00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.701524:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91532f978 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701532:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91532f978 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701543:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91532f978 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701550:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91532f978 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.701563:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.701564:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.701566:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383502.702001:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.702008:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddca1b20/0xc40acec91532f97f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.702019:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.702022:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.702027:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddca1b20/0xc40acec91532f97f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.702037:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddca1b20/0xc40acec91532f97f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.702050:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddca1b20/0xc40acec91532f97f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.702057:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddca1b20/0xc40acec91532f97f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.702069:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787383502.702310:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.702316:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbb1d2de/0xc40acec91532f986 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.702324:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.702328:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.702332:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbb1d2de/0xc40acec91532f986 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.702341:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbb1d2de/0xc40acec91532f986 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.702348:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbb1d2de/0xc40acec91532f986 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.702355:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbb1d2de/0xc40acec91532f986 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.702375:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787383502.702615:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383502.702622:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddca1b20/0xc40acec91532f97f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.702631:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383502.702635:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddca1b20/0xc40acec91532f97f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.702644:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddca1b20/0xc40acec91532f97f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.702657:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddca1b20/0xc40acec91532f97f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.702686:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddca1b20/0xc40acec91532f97f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.702710:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383502.702714:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbb1d2de/0xc40acec91532f986 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.702720:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fc400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383502.702723:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbb1d2de/0xc40acec91532f986 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.702739:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbb1d2de/0xc40acec91532f986 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.702751:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbb1d2de/0xc40acec91532f986 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.702758:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbb1d2de/0xc40acec91532f986 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.702788:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383502.702790:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383502.702792:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383502.703137:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.703144:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7f2ec6c/0xc40acec91532f98d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.703153:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.703156:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.703161:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7f2ec6c/0xc40acec91532f98d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.703170:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7f2ec6c/0xc40acec91532f98d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.703178:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7f2ec6c/0xc40acec91532f98d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.703185:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7f2ec6c/0xc40acec91532f98d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.703202:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383502.703429:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383502.703435:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7f2ec6c/0xc40acec91532f98d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.703449:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fd200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383502.703453:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7f2ec6c/0xc40acec91532f98d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.703461:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7f2ec6c/0xc40acec91532f98d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.703473:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7f2ec6c/0xc40acec91532f98d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.703480:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7f2ec6c/0xc40acec91532f98d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383502.703495:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383502.703496:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383502.703498:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383502.704026:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.704032:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000850bcb3d/0xc40acec91532f994 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.704042:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.704051:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.704057:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000850bcb3d/0xc40acec91532f994 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.704067:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000850bcb3d/0xc40acec91532f994 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.704077:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000850bcb3d/0xc40acec91532f994 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.704084:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000850bcb3d/0xc40acec91532f994 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.704101:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383502.704990:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383502.704999:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000850bcb3d/0xc40acec91532f994 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.705010:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fda00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383502.705015:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000850bcb3d/0xc40acec91532f994 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.705023:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000850bcb3d/0xc40acec91532f994 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.705040:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000850bcb3d/0xc40acec91532f994 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.705047:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000850bcb3d/0xc40acec91532f994 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.705065:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.705067:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.705069:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383502.708233:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.708248:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cceabf8/0xc40acec91532f99b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708265:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.708269:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.708276:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cceabf8/0xc40acec91532f99b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708290:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cceabf8/0xc40acec91532f99b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708299:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cceabf8/0xc40acec91532f99b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708313:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cceabf8/0xc40acec91532f99b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708339:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383502.708522:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383502.708529:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cceabf8/0xc40acec91532f99b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708537:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fdc00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.708541:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cceabf8/0xc40acec91532f99b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708551:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cceabf8/0xc40acec91532f99b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708566:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cceabf8/0xc40acec91532f99b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708573:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cceabf8/0xc40acec91532f99b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708593:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.708594:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.708596:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.708603:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383502.708651:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.708658:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532f9a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708666:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.708669:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.708673:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532f9a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708682:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532f9a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708688:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532f9a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708694:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532f9a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708710:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383502.708718:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383502.708721:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532f9a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708727:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fce00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.708742:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532f9a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708761:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532f9a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708793:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532f9a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708800:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532f9a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.708814:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.708815:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.708817:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383502.713387:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.713398:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087bbfc6a/0xc40acec91532f9a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713415:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.713419:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.713425:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087bbfc6a/0xc40acec91532f9a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713438:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087bbfc6a/0xc40acec91532f9a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713450:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087bbfc6a/0xc40acec91532f9a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713463:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087bbfc6a/0xc40acec91532f9a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713479:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383502.713491:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383502.713496:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087bbfc6a/0xc40acec91532f9a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713504:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fd800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.713509:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087bbfc6a/0xc40acec91532f9a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713518:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087bbfc6a/0xc40acec91532f9a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713536:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087bbfc6a/0xc40acec91532f9a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713544:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087bbfc6a/0xc40acec91532f9a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713563:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.713565:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.713567:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383502.713906:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.713918:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532f9b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713928:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.713931:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.713936:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532f9b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713945:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532f9b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713953:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532f9b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713959:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532f9b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713973:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383502.713980:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383502.713984:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532f9b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.713990:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fde00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.713994:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532f9b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714001:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532f9b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714018:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532f9b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714026:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532f9b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714039:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.714041:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.714042:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383502.714459:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.714465:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f50e5a5/0xc40acec91532f9b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714473:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.714476:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.714480:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f50e5a5/0xc40acec91532f9b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714489:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f50e5a5/0xc40acec91532f9b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714497:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f50e5a5/0xc40acec91532f9b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714505:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f50e5a5/0xc40acec91532f9b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714529:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383502.714537:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383502.714541:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f50e5a5/0xc40acec91532f9b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714546:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.714549:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f50e5a5/0xc40acec91532f9b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714557:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f50e5a5/0xc40acec91532f9b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714568:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f50e5a5/0xc40acec91532f9b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714576:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f50e5a5/0xc40acec91532f9b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714590:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.714592:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.714593:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383502.714959:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.714965:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051f98376/0xc40acec91532f9be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714973:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.714982:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.714986:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051f98376/0xc40acec91532f9be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.714995:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051f98376/0xc40acec91532f9be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.715002:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051f98376/0xc40acec91532f9be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.715010:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051f98376/0xc40acec91532f9be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.715023:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383502.715031:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383502.715035:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051f98376/0xc40acec91532f9be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.715041:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7600 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.715044:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f98376/0xc40acec91532f9be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.715051:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051f98376/0xc40acec91532f9be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.715060:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051f98376/0xc40acec91532f9be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.715077:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051f98376/0xc40acec91532f9be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.715091:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.715092:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.715094:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383502.716991:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.717001:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066f36627/0xc40acec91532f9c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717017:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.717020:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.717025:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066f36627/0xc40acec91532f9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717037:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066f36627/0xc40acec91532f9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717045:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066f36627/0xc40acec91532f9c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717052:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066f36627/0xc40acec91532f9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717069:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383502.717078:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.717083:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066f36627/0xc40acec91532f9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717096:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.717101:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066f36627/0xc40acec91532f9c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717108:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066f36627/0xc40acec91532f9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717122:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066f36627/0xc40acec91532f9c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717129:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066f36627/0xc40acec91532f9c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717143:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.717145:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.717146:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383502.717482:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.717488:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec91532f9cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717496:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.717499:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.717504:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec91532f9cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717513:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec91532f9cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717528:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec91532f9cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717535:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec91532f9cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717550:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383502.717558:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.717562:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec91532f9cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717569:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7600 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.717573:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec91532f9cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717581:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec91532f9cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717592:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec91532f9cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717598:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec91532f9cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717611:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.717617:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.717619:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383502.717969:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.717975:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f41d550d/0xc40acec91532f9d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717984:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.717987:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.717991:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f41d550d/0xc40acec91532f9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.717999:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f41d550d/0xc40acec91532f9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.718006:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f41d550d/0xc40acec91532f9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.718012:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f41d550d/0xc40acec91532f9d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.718027:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383502.718034:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.718037:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f41d550d/0xc40acec91532f9d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.718043:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.718046:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f41d550d/0xc40acec91532f9d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.718064:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f41d550d/0xc40acec91532f9d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.718075:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f41d550d/0xc40acec91532f9d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.718082:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f41d550d/0xc40acec91532f9d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.718096:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.718098:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.718099:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383502.719129:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.719139:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a58415/0xc40acec91532f9da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719152:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.719156:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.719161:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a58415/0xc40acec91532f9da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719170:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4a58415/0xc40acec91532f9da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719178:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a58415/0xc40acec91532f9da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719193:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a58415/0xc40acec91532f9da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719208:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383502.719218:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.719222:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4a58415/0xc40acec91532f9da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719229:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.719233:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a58415/0xc40acec91532f9da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719241:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a58415/0xc40acec91532f9da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719255:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4a58415/0xc40acec91532f9da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719262:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4a58415/0xc40acec91532f9da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719277:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.719278:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.719280:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383502.719430:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.719442:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec91532f9e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719451:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.719454:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.719458:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec91532f9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719467:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec91532f9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719473:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec91532f9e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719480:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec91532f9e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719494:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383502.719502:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.719505:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec91532f9e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719512:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.719516:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec91532f9e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719523:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec91532f9e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719538:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec91532f9e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719545:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec91532f9e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.719558:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.719560:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.719561:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.721046:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383502.726012:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.726024:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a480cedf/0xc40acec91532f9e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726042:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.726046:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.726054:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a480cedf/0xc40acec91532f9e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726067:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a480cedf/0xc40acec91532f9e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726077:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a480cedf/0xc40acec91532f9e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726085:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a480cedf/0xc40acec91532f9e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726114:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383502.726125:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.726131:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a480cedf/0xc40acec91532f9e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726139:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7a00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.726144:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a480cedf/0xc40acec91532f9e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726153:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a480cedf/0xc40acec91532f9e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726170:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a480cedf/0xc40acec91532f9e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726176:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a480cedf/0xc40acec91532f9e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726194:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.726195:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.726197:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383502.726638:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.726645:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587e6b39/0xc40acec91532f9ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726654:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.726662:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.726667:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587e6b39/0xc40acec91532f9ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726688:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000587e6b39/0xc40acec91532f9ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726704:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587e6b39/0xc40acec91532f9ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726711:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000587e6b39/0xc40acec91532f9ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726726:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383502.726742:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.726746:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000587e6b39/0xc40acec91532f9ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726753:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.726757:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000587e6b39/0xc40acec91532f9ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726791:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000587e6b39/0xc40acec91532f9ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726805:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000587e6b39/0xc40acec91532f9ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726823:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587e6b39/0xc40acec91532f9ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.726837:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.726839:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.726841:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383502.727321:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.727328:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bea442b/0xc40acec91532f9f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.727338:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.727341:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.727346:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bea442b/0xc40acec91532f9f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.727355:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bea442b/0xc40acec91532f9f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.727363:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bea442b/0xc40acec91532f9f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.727370:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bea442b/0xc40acec91532f9f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.727389:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787383502.729368:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.729386:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c263776e/0xc40acec91532f9fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729403:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.729407:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.729413:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c263776e/0xc40acec91532f9fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729426:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c263776e/0xc40acec91532f9fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729436:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c263776e/0xc40acec91532f9fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729444:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c263776e/0xc40acec91532f9fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729460:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787383502.729470:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383502.729477:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bea442b/0xc40acec91532f9f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729484:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.729489:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bea442b/0xc40acec91532f9f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729497:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bea442b/0xc40acec91532f9f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729519:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bea442b/0xc40acec91532f9f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729527:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bea442b/0xc40acec91532f9f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729545:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.729549:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c263776e/0xc40acec91532f9fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729556:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.729559:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c263776e/0xc40acec91532f9fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729566:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c263776e/0xc40acec91532f9fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729575:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c263776e/0xc40acec91532f9fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729581:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c263776e/0xc40acec91532f9fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.729591:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.729593:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.729600:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383502.730477:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.730485:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.730496:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.730499:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.730503:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.730512:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.730519:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.730526:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.730540:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383502.730548:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.730552:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.730559:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.730563:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.730581:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.730594:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.730600:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.730615:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.730616:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.730618:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.731006:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383502.731054:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.731061:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.731072:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.731082:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.731088:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.731099:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.731107:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.731114:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.731135:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383502.731276:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383502.731282:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.731289:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.731293:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.731301:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.731315:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.731322:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.731337:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.731338:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.731340:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787383502.731678:0:19416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00002000:00010000:1.0:1787383502.731981:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.731988:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec91532fa12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.731998:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.732002:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.732008:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec91532fa12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.732017:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec91532fa12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.732026:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec91532fa12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.732043:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec91532fa12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.732060:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383502.732248:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383502.732255:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec91532fa12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.732263:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6a00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383502.732267:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec91532fa12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.732276:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec91532fa12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.732290:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec91532fa12 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.732309:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec91532fa12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.732325:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.732326:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.732328:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787383502.732474:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787383502.732480:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1787383502.732568:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.732574:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057ad162e/0xc40acec91532fa19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.732584:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.732587:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.732591:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057ad162e/0xc40acec91532fa19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.732601:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057ad162e/0xc40acec91532fa19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.732609:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057ad162e/0xc40acec91532fa19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.732616:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057ad162e/0xc40acec91532fa19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.732637:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383502.732858:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383502.732864:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057ad162e/0xc40acec91532fa19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.732871:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.732874:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057ad162e/0xc40acec91532fa19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.732881:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057ad162e/0xc40acec91532fa19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.732892:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057ad162e/0xc40acec91532fa19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.732898:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057ad162e/0xc40acec91532fa19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.732911:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.732912:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.732914:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383502.733090:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17839:x1874206984969344:12345-0@lo:5:osp-pre-1-1.0 Request processed in 82699us (82761us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787383502.733100:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383502.733821:0:17839:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787383502.733833:0:17839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17839:1874206984969344:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787383502.733849:0:17839:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787383502.733904:0:17839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17839:1874206984969472:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787383502.733952:0:17839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383502.733978:0:17839:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635022ce180 going to sleep for 11 seconds 00000100:00100000:2.0:1787383502.733996:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984969472 00000100:00100000:2.0:1787383502.734002:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984969472 00000100:00100000:2.0:1787383502.734043:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787383502.734050:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17839:x1874206984969472:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787383502.734096:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17839:x1874206984969472:12345-0@lo:900:osp-pre-1-1.0 Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383502.734103:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787383502.734134:0:17839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447a300 x1874206984969472/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787383518 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383502.734145:0:17839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17839:1874206984969472:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1787383502.734989:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.735000:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d87736d/0xc40acec91532fa20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.735021:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.735025:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.735032:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d87736d/0xc40acec91532fa20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.735044:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d87736d/0xc40acec91532fa20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.735054:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d87736d/0xc40acec91532fa20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.735061:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d87736d/0xc40acec91532fa20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.735082:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383502.735258:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383502.735266:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d87736d/0xc40acec91532fa20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.735274:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6600 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383502.735278:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d87736d/0xc40acec91532fa20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.735287:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d87736d/0xc40acec91532fa20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.735303:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d87736d/0xc40acec91532fa20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.735311:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d87736d/0xc40acec91532fa20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.735342:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.735343:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.735345:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383502.735438:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383502.735444:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1ebb9cd/0xc40acec91532fa27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.735451:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.735454:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383502.735458:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ebb9cd/0xc40acec91532fa27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.735468:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1ebb9cd/0xc40acec91532fa27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.735475:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1ebb9cd/0xc40acec91532fa27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.735492:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ebb9cd/0xc40acec91532fa27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.735514:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383502.735841:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383502.735847:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1ebb9cd/0xc40acec91532fa27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.735855:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383502.735858:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1ebb9cd/0xc40acec91532fa27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.735867:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1ebb9cd/0xc40acec91532fa27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.735878:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1ebb9cd/0xc40acec91532fa27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.735885:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1ebb9cd/0xc40acec91532fa27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.735899:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.735901:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.735902:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383502.737248:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.737259:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076f337ca/0xc40acec91532fa2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.737273:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.737277:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.737282:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076f337ca/0xc40acec91532fa2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.737294:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076f337ca/0xc40acec91532fa2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.737314:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076f337ca/0xc40acec91532fa2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.737321:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076f337ca/0xc40acec91532fa2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.737337:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383502.737534:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383502.737540:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076f337ca/0xc40acec91532fa2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.737549:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.737553:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076f337ca/0xc40acec91532fa2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.737561:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076f337ca/0xc40acec91532fa2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.737576:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076f337ca/0xc40acec91532fa2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.737583:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076f337ca/0xc40acec91532fa2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.737599:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.737601:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.737603:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383502.738102:0:18602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383502.738108:0:18602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.738118:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1787383502.738121:0:18602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383502.738126:0:18602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.738136:0:18602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.738144:0:18602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.738151:0:18602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.738188:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787383502.738240:0:18602:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1787383502.738330:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17121:x1874206984968832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 110333us (113120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383502.738344:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787383502.738396:0:17121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17121:1874206984968832:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787383502.738411:0:17121:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1787383502.738454:0:17121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17121:1874206984969600:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787383502.738485:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383502.738509:0:17121:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620ee1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787383502.738527:0:19237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984969600 00000100:00100000:1.0:1787383502.738533:0:19237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984969600 00000100:00100000:1.0:1787383502.738569:0:19237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787383502.738577:0:19237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17121:x1874206984969600:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787383502.738609:0:19237:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1787383502.740980:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383502.741001:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.741015:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383502.741020:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.741030:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.741049:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.741055:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec91532fa35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.741081:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.741083:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.741084:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383502.743392:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.743403:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91532fa3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.743431:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.743436:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.743443:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91532fa3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.743458:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91532fa3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.743467:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91532fa3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.743475:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91532fa3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.743500:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787383502.744044:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.744051:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532fa43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744061:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.744065:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.744069:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532fa43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744078:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532fa43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744098:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532fa43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744106:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532fa43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744128:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787383502.744398:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.744404:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532fa4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744412:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.744414:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.744418:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532fa4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744425:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532fa4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744432:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532fa4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744439:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532fa4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744463:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787383502.744473:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787383502.744477:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91532fa3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744484:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383502.744488:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91532fa3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744496:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91532fa3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744513:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91532fa3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744521:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91532fa3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744536:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383502.744539:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532fa43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744545:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383502.744548:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532fa43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744567:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532fa43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744577:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532fa43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744584:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec3112d0/0xc40acec91532fa43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744596:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383502.744600:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532fa4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744605:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383502.744607:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532fa4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744614:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532fa4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744623:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532fa4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744630:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec91532fa4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.744652:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.744654:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.744656:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.747033:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383502.747278:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.747287:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec91532fa51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747303:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.747307:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.747313:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec91532fa51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747326:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec91532fa51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747335:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec91532fa51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747343:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec91532fa51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747358:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383502.747366:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383502.747372:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec91532fa51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747392:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383502.747397:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec91532fa51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747407:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec91532fa51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747422:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec91532fa51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747430:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec91532fa51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747446:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.747448:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.747449:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383502.747880:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.747887:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747897:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.747900:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.747905:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747914:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747928:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747936:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.747948:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787383502.748177:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.748182:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532fa5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748190:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1787383502.748192:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383502.748193:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.748197:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532fa5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.748198:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.748206:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383502.748207:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532fa5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.748210:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748215:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532fa5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748222:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532fa5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748247:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383502.748255:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383502.748258:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532fa5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748264:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383502.748267:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532fa5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748275:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532fa5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748287:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532fa5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748293:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec91532fa5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748306:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.748307:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.748308:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.748393:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.748404:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.748412:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec91532fa58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383502.748432:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.748434:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383502.748436:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383502.748542:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.748548:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7f2ec6c/0xc40acec91532fa66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748556:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.748566:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.748571:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f2ec6c/0xc40acec91532fa66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748579:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7f2ec6c/0xc40acec91532fa66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748586:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7f2ec6c/0xc40acec91532fa66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748593:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f2ec6c/0xc40acec91532fa66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748607:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383502.748613:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383502.748616:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7f2ec6c/0xc40acec91532fa66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748623:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fd200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383502.748626:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7f2ec6c/0xc40acec91532fa66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748633:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7f2ec6c/0xc40acec91532fa66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748642:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7f2ec6c/0xc40acec91532fa66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.748659:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7f2ec6c/0xc40acec91532fa66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383502.748870:0:19237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17121:x1874206984969600:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10289us (10380us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787383502.748882:0:19237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787383502.748951:0:17121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17121:1874206984969600:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787383502.748965:0:17121:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1787383502.748981:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.749062:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.749065:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.749067:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383502.749355:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.749361:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbb1d2de/0xc40acec91532fa6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.749371:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.749374:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.749380:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbb1d2de/0xc40acec91532fa6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.749390:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbb1d2de/0xc40acec91532fa6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.749398:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbb1d2de/0xc40acec91532fa6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.749446:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbb1d2de/0xc40acec91532fa6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.749505:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383502.749828:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.749833:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbb1d2de/0xc40acec91532fa6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.749851:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fc400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.749855:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbb1d2de/0xc40acec91532fa6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.749863:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbb1d2de/0xc40acec91532fa6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.749875:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbb1d2de/0xc40acec91532fa6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.749882:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbb1d2de/0xc40acec91532fa6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.749897:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.749899:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.749900:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383502.749989:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.750000:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532fa74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.750008:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.750011:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.750015:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532fa74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.750024:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532fa74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.750031:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532fa74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.750037:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532fa74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.750085:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787383502.750332:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.750338:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087bbfc6a/0xc40acec91532fa7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.750346:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.750349:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.750353:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087bbfc6a/0xc40acec91532fa7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.750362:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087bbfc6a/0xc40acec91532fa7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.750377:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087bbfc6a/0xc40acec91532fa7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.750384:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087bbfc6a/0xc40acec91532fa7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.750442:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383502.750447:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532fa74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.750454:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fde00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.750458:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532fa74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.750466:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532fa74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.750483:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532fa74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.750490:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042d263d7/0xc40acec91532fa74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.750504:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.750507:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087bbfc6a/0xc40acec91532fa7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.750513:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fd800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.750516:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087bbfc6a/0xc40acec91532fa7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.750524:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087bbfc6a/0xc40acec91532fa7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.750533:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087bbfc6a/0xc40acec91532fa7b lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.750541:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.750542:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.750545:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.750602:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787383502.750607:0:18600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087bbfc6a/0xc40acec91532fa7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383502.750973:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.750979:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532fa82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.750987:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.750991:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.750996:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532fa82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.751004:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532fa82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.751011:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532fa82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.751026:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532fa82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.751070:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.751077:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532fa82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.751094:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fce00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.751097:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532fa82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.751104:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532fa82 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.751114:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532fa82 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.751122:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.751123:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.751125:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.751181:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787383502.751186:0:18600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864d1661/0xc40acec91532fa82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383502.751480:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.751486:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cceabf8/0xc40acec91532fa89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.751494:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.751497:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.751501:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cceabf8/0xc40acec91532fa89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.751509:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cceabf8/0xc40acec91532fa89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.751516:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cceabf8/0xc40acec91532fa89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.751522:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cceabf8/0xc40acec91532fa89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.751557:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.751562:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cceabf8/0xc40acec91532fa89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.751568:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fdc00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.751572:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cceabf8/0xc40acec91532fa89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.751579:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cceabf8/0xc40acec91532fa89 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.751589:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cceabf8/0xc40acec91532fa89 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.751601:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.751603:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.751604:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.751659:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787383502.751664:0:18600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cceabf8/0xc40acec91532fa89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383502.752086:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.752093:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000850bcb3d/0xc40acec91532fa90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.752101:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.752104:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.752108:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000850bcb3d/0xc40acec91532fa90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.752116:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000850bcb3d/0xc40acec91532fa90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.752123:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000850bcb3d/0xc40acec91532fa90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.752129:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000850bcb3d/0xc40acec91532fa90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.752176:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.752181:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000850bcb3d/0xc40acec91532fa90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.752188:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fda00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.752192:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000850bcb3d/0xc40acec91532fa90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.752200:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000850bcb3d/0xc40acec91532fa90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.752211:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000850bcb3d/0xc40acec91532fa90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.752218:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.752219:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.752221:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.752275:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787383502.752280:0:18600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000850bcb3d/0xc40acec91532fa90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383502.752571:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.752577:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004bd47b1/0xc40acec91532fa97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.752586:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.752589:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.752593:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004bd47b1/0xc40acec91532fa97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.752602:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004bd47b1/0xc40acec91532fa97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.752610:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004bd47b1/0xc40acec91532fa97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.752616:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004bd47b1/0xc40acec91532fa97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.752646:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.752651:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004bd47b1/0xc40acec91532fa97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.752658:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.752661:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004bd47b1/0xc40acec91532fa97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.752688:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004bd47b1/0xc40acec91532fa97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.752822:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004bd47b1/0xc40acec91532fa97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.752831:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.752832:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.752834:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.752902:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787383502.752907:0:18600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004bd47b1/0xc40acec91532fa97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383502.753187:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.753193:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c05176d6/0xc40acec91532fa9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.753212:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.753215:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.753219:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c05176d6/0xc40acec91532fa9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.753228:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c05176d6/0xc40acec91532fa9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.753236:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c05176d6/0xc40acec91532fa9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.753244:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c05176d6/0xc40acec91532fa9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.753270:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.753275:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c05176d6/0xc40acec91532fa9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.753283:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.753287:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c05176d6/0xc40acec91532fa9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.753294:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c05176d6/0xc40acec91532fa9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.753306:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c05176d6/0xc40acec91532fa9e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.753314:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.753315:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.753317:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.753379:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787383502.753384:0:18600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c05176d6/0xc40acec91532fa9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383502.753649:0:18600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383502.753655:0:18600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a7326a/0xc40acec91532faa5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.753662:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1787383502.753665:0:18600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383502.753682:0:18600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a7326a/0xc40acec91532faa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.753821:0:18600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a7326a/0xc40acec91532faa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.753830:0:18600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a7326a/0xc40acec91532faa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383502.753837:0:18600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a7326a/0xc40acec91532faa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.753888:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383502.753893:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a7326a/0xc40acec91532faa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.753901:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac9a00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383502.753905:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a7326a/0xc40acec91532faa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.753912:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a7326a/0xc40acec91532faa5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.753922:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a7326a/0xc40acec91532faa5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383502.753928:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.753930:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383502.753932:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383502.753994:0:18600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787383502.753999:0:18600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a7326a/0xc40acec91532faa5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787383502.754045:0:18600:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1787383502.754132:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17119:x1874206984969088:12345-0@lo:5:osp-pre-0-0.0 Request processed in 112671us (128134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383502.754142:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383502.754193:0:17119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17119:1874206984969088:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787383502.754207:0:17119:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1787383502.754250:0:17119:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17119:1874206984969728:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787383502.754288:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383502.754309:0:17119:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11540 going to sleep for 11 seconds 00000100:00100000:0.0:1787383502.754325:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984969728 00000100:00100000:0.0:1787383502.754331:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984969728 00000100:00100000:0.0:1787383502.754378:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383502.754386:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17119:x1874206984969728:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787383502.754420:0:18599:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:1.0:1787383502.756818:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787383502.760143:0:18596:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1787383502.760184:0:18596:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787383502.760388:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17119:x1874206984969728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5997us (6094us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787383502.760399:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787383502.760491:0:17119:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787383502.760499:0:17119:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17119:1874206984969728:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787383502.760514:0:17119:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1787383503.514972:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787383503.865020:0:19773:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787383504.540065:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984969856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383504.540178:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383504.540322:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984969856 00000100:00100000:0.0:1787383504.540372:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984969856 00000100:00080000:3.0:1787383504.540472:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383504.540570:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383504.540600:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984969856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787383504.540692:0:18604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787383504.541838:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984969856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1239us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383504.541850:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383504.541873:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984969856:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787383504.542025:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787383504.815833:0:19825:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383504.816134:0:19825:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787383505.563990:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383505.564024:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984969984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383505.564119:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383505.564188:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984969984 00000100:00100000:2.0:1787383505.564197:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984969984 00000100:00100000:2.0:1787383505.564258:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787383505.564270:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984969984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787383505.564488:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787383505.564548:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984969984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 279us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383505.564556:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787383505.564760:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984969984:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787383505.565005:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383505.572596:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383505.572647:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984970112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383505.572812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383505.573182:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984970112 00000100:00100000:3.0:1787383505.573197:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984970112 00000100:00100000:3.0:1787383505.573271:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787383505.573293:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984970112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787383505.573352:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787383505.573428:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984970112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383505.573436:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787383505.573832:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984970112:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1787383506.153717:0:19875:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787383506.156633:0:19875:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787383506.450858:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383506.450947:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966008448 00000100:00100000:3.0:1787383506.450957:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966008448 00000100:00100000:3.0:1787383506.451007:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 113 00000100:00100000:3.0:1787383506.451016:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2400:x1874206966008448:12345-192.168.203.2@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787383506.451045:0:17089:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 67005cab-7d30-4f92-84d7-5c04932340db@192.168.203.2@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:3.0:1787383506.451077:0:17089:0:(genops.c:1406:class_connect()) connect: client 67005cab-7d30-4f92-84d7-5c04932340db, cookie 0xc40acec91532faac 00000100:00080000:3.0:1787383506.451208:0:17089:0:(import.c:65:import_set_state_nolock()) ffff96363f99d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383506.451277:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+5:2400:x1874206966008448:12345-192.168.203.2@tcp:250:mount.lustre.0 Request processed in 259us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383506.451285:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 113 00000100:00100000:2.0:1787383506.462876:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383506.463594:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966008576 00000100:00100000:3.0:1787383506.463605:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966008576 00000100:00100000:3.0:1787383506.463670:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 114 00000100:00100000:3.0:1787383506.463688:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+5:14899:x1874206966008576:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787383506.463712:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383506.463730:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963600031200/0xc40acec91532fab3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402ab4 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383506.463761:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963600031200/0xc40acec91532fab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402ab4 expref: 6 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383506.463828:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963600031200/0xc40acec91532fab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402ab4 expref: 6 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383506.463837:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600031200, rc 0) 00000100:00100000:3.0:1787383506.463904:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+6:14899:x1874206966008576:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 209us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383506.463912:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 114 00000100:00100000:2.0:1787383506.466755:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383506.466916:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966008704 00000100:00100000:0.0:1787383506.466925:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966008704 00000100:00100000:0.0:1787383506.466978:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:0.0:1787383506.466989:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+6:14899:x1874206966008704:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787383506.467103:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+6:14899:x1874206966008704:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 115us (356us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787383506.467111:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:2.0:1787383506.471502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383506.471635:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966008832 00000100:00100000:0.0:1787383506.471660:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966008832 00000100:00100000:0.0:1787383506.471729:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:0.0:1787383506.471738:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+6:14899:x1874206966008832:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787383506.471754:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383506.471826:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96363dac8800/0xc40acec91532faba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402abb expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383506.471854:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac8800/0xc40acec91532faba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402abb expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383506.471866:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96363dac8800/0xc40acec91532faba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402abb expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383506.471874:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac8800, rc 0) 00000100:00100000:0.0:1787383506.472150:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+7:14899:x1874206966008832:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 412us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383506.472158:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:2.0:1787383506.477254:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383506.477331:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966008960 00000100:00100000:3.0:1787383506.477340:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966008960 00000100:00100000:3.0:1787383506.477395:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 117 00000100:00100000:3.0:1787383506.477413:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+7:14899:x1874206966008960:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787383506.477558:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+8:14899:x1874206966008960:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 154us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383506.477565:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 117 00000100:00100000:2.0:1787383506.499576:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383506.499689:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966009088 00000100:00100000:0.0:1787383506.499698:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966009088 00000100:00100000:0.0:1787383506.499830:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 118 00000100:00100000:0.0:1787383506.499840:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+8:14899:x1874206966009088:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787383506.500696:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+8:14899:x1874206966009088:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 853us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383506.500717:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 118 00000100:00100000:2.0:1787383506.507528:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383506.507614:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966009216 00000100:00100000:0.0:1787383506.507625:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966009216 00000100:00100000:0.0:1787383506.507685:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 119 00000100:00100000:0.0:1787383506.507695:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+8:14917:x1874206966009216:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383506.507883:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+8:14917:x1874206966009216:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 188us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383506.507892:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 119 00000100:00100000:2.0:1787383506.531757:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383506.532789:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966009344 00000100:00100000:0.0:1787383506.532803:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966009344 00000100:00100000:0.0:1787383506.532867:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 120 00000100:00100000:0.0:1787383506.532877:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+8:14917:x1874206966009344:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383506.533038:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+8:14917:x1874206966009344:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 162us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383506.533046:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 120 00000100:00100000:2.0:1787383506.541461:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383506.541554:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966009472 00000100:00100000:3.0:1787383506.541564:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966009472 00000100:00100000:3.0:1787383506.541625:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 121 00000100:00100000:3.0:1787383506.541636:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+8:14917:x1874206966009472:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787383506.541830:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+8:14917:x1874206966009472:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 196us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383506.541839:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 121 00000100:00100000:2.0:1787383506.546257:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383506.546358:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966009600 00000100:00100000:3.0:1787383506.546368:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966009600 00000100:00100000:3.0:1787383506.546511:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 122 00000100:00100000:3.0:1787383506.546521:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+8:14899:x1874206966009600:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787383506.546548:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383506.546565:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963600031400/0xc40acec91532fac1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402aec expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383506.546592:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963600031400/0xc40acec91532fac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402aec expref: 9 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383506.546602:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963600031400/0xc40acec91532fac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402aec expref: 9 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383506.546610:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600031400, rc 0) 00000100:00100000:3.0:1787383506.546673:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+9:14899:x1874206966009600:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 153us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383506.546681:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 122 00000100:00100000:2.0:1787383506.567166:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383506.567594:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966009728 00000100:00100000:0.0:1787383506.567604:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966009728 00000100:00100000:0.0:1787383506.567665:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:0.0:1787383506.567686:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+9:14899:x1874206966009728:12345-192.168.203.2@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787383506.567719:0:17089:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787383506.567744:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787383506.567748:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787383506.567751:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787383506.567754:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787383506.567756:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787383506.569406:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+9:14899:x1874206966009728:12345-192.168.203.2@tcp:256:mount.lustre.0 Request processed in 1718us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383506.569420:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:2.0:1787383506.586331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383506.586419:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966009856 00000100:00100000:3.0:1787383506.586428:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966009856 00000100:00100000:3.0:1787383506.586484:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:3.0:1787383506.586493:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+9:14899:x1874206966009856:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787383506.586509:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383506.586526:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963600031e00/0xc40acec91532fac8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402af3 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383506.586554:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963600031e00/0xc40acec91532fac8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402af3 expref: 10 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383506.586565:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963600031e00/0xc40acec91532fac8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402af3 expref: 10 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383506.586591:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600031e00, rc 0) 00000100:00100000:3.0:1787383506.586658:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+10:14899:x1874206966009856:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 165us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383506.586665:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 124 00010000:00010000:3.0:1787383506.598941:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383506.599744:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383506.604233:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966009984 00000100:00100000:0.0:1787383506.604247:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966009984 00000100:00100000:0.0:1787383506.604327:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00100000:0.0:1787383506.604339:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+10:14899:x1874206966009984:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787383506.605057:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+10:14899:x1874206966009984:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 718us (5316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383506.605075:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00100000:0.0:1787383506.626690:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383506.626830:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966010112 00000100:00100000:3.0:1787383506.626839:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966010112 00000100:00100000:3.0:1787383506.626894:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:3.0:1787383506.626904:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+10:14899:x1874206966010112:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787383506.627047:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+10:14899:x1874206966010112:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 144us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383506.627056:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:2.0:1787383506.630529:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383506.632394:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966010240 00000100:00100000:0.0:1787383506.632409:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966010240 00000100:00100000:0.0:1787383506.632472:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 127 00000100:00100000:0.0:1787383506.632481:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636346ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+10:14923:x1874206966010240:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383506.632645:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636346ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+10:14923:x1874206966010240:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 164us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383506.632653:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 127 00000100:00100000:2.0:1787383506.640550:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383506.648526:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966010368 00000100:00100000:0.0:1787383506.648548:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966010368 00000100:00100000:0.0:1787383506.648659:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 128 00000100:00100000:0.0:1787383506.648672:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+10:14923:x1874206966010368:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383506.648921:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635036d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+10:14923:x1874206966010368:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 250us (8383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383506.648932:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 128 00000100:00100000:2.0:1787383506.659052:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383506.659171:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383506.660106:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966010496 00000100:00100000:3.0:1787383506.660131:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966010496 00000100:00100000:3.0:1787383506.660188:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966010752 00000100:00100000:3.0:1787383506.660192:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966010752 00000100:00100000:3.0:1787383506.660229:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:3.0:1787383506.660240:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1874206966010496:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787383506.660279:0:17094:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from eeae0f85-81db-4a53-adaf-9a6519b93273@192.168.203.2@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:3.0:1787383506.660343:0:17094:0:(genops.c:1406:class_connect()) connect: client eeae0f85-81db-4a53-adaf-9a6519b93273, cookie 0xc40acec91532facf 00000004:00100000:3.0:1787383506.660375:0:17094:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787383506.661323:0:17094:0:(import.c:65:import_set_state_nolock()) ffff96363f998000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383506.661942:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:2.0:1787383506.661953:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1874206966010752:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787383506.661987:0:19236:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from eeae0f85-81db-4a53-adaf-9a6519b93273@192.168.203.2@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:2.0:1787383506.662051:0:19236:0:(genops.c:1406:class_connect()) connect: client eeae0f85-81db-4a53-adaf-9a6519b93273, cookie 0xc40acec91532fad6 00000004:00100000:2.0:1787383506.662079:0:19236:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787383506.663590:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+6:2400:x1874206966010496:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 3341us (4542us total) trans 0 rc 0/0 00000100:00080000:2.0:1787383506.664081:0:19236:0:(import.c:65:import_set_state_nolock()) ffff963638b79800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383506.665635:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:2.0:1787383506.666853:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+6:2400:x1874206966010752:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 4893us (7673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383506.666866:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:1.0:1787383506.685039:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383506.685097:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383506.685141:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383506.685319:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966010624 00000100:00100000:3.0:1787383506.685332:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966010624 00000100:00100000:3.0:1787383506.685427:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966011008 00000100:00100000:3.0:1787383506.685432:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966011008 00000100:00100000:3.0:1787383506.685444:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966010880 00000100:00100000:3.0:1787383506.685446:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966010880 00000100:00100000:3.0:1787383506.685468:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:3.0:1787383506.685479:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+7:0:x1874206966010624:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787383506.685531:0:19236:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787383506.685687:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+7:0:x1874206966010624:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 208us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383506.685695:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:3.0:1787383506.685726:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:3.0:1787383506.685732:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14899:x1874206966011008:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787383506.685744:0:19236:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787383506.685801:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14899:x1874206966011008:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 35us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383506.685808:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:3.0:1787383506.685820:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:3.0:1787383506.685826:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+6:0:x1874206966010880:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787383506.685843:0:19236:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787383506.685877:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+6:0:x1874206966010880:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 51us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383506.685883:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00080000:1.0:1787383506.687251:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383506.687263:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383506.688159:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383506.688282:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966011136 00000100:00100000:3.0:1787383506.688295:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966011136 00000100:00100000:3.0:1787383506.688427:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:3.0:1787383506.688439:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14899:x1874206966011136:12345-192.168.203.2@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787383506.688556:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14899:x1874206966011136:12345-192.168.203.2@tcp:40:mount.lustre.0 Request processed in 119us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383506.688565:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:3.0:1787383506.694238:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383506.694291:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383506.694398:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383506.694509:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966011520 00000100:00100000:2.0:1787383506.694522:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966011520 00000100:00100000:2.0:1787383506.694591:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:2.0:1787383506.694602:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14899:x1874206966011520:12345-192.168.203.2@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787383506.694683:0:19237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966011264 00000100:00100000:1.0:1787383506.694690:0:19237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966011264 00000100:00100000:2.0:1787383506.694694:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14899:x1874206966011520:12345-192.168.203.2@tcp:900:mount.lustre.0 Request processed in 93us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383506.694701:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:1.0:1787383506.694730:0:19237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966011392 00000100:00100000:1.0:1787383506.694734:0:19237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966011392 00000100:00100000:1.0:1787383506.694757:0:19237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:1.0:1787383506.694990:0:19237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2400:x1874206966011264:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787383506.695028:0:19237:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from eeae0f85-81db-4a53-adaf-9a6519b93273@192.168.203.2@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:1.0:1787383506.695070:0:19237:0:(genops.c:1406:class_connect()) connect: client eeae0f85-81db-4a53-adaf-9a6519b93273, cookie 0xc40acec91532fadd 00002000:00100000:1.0:1787383506.695084:0:19237:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eeae0f85-81db-4a53-adaf-9a6519b93273/ffff96361122f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787383506.695118:0:19237:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787383506.695201:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:2.0:1787383506.695210:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1874206966011392:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787383506.695232:0:18602:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from eeae0f85-81db-4a53-adaf-9a6519b93273@192.168.203.2@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:2.0:1787383506.695259:0:18602:0:(genops.c:1406:class_connect()) connect: client eeae0f85-81db-4a53-adaf-9a6519b93273, cookie 0xc40acec91532fae4 00002000:00100000:2.0:1787383506.695266:0:18602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eeae0f85-81db-4a53-adaf-9a6519b93273/ffff963622d86800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383506.695284:0:18602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787383506.695349:0:19237:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787383506.695388:0:19237:0:(import.c:65:import_set_state_nolock()) ffff96361122b800 : changing import state from RECOVER to FULL 00002000:00080000:2.0:1787383506.695435:0:18602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1787383506.695452:0:19237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+6:2400:x1874206966011264:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 686us (1158us total) trans 0 rc 0/0 00000100:00080000:2.0:1787383506.695453:0:18602:0:(import.c:65:import_set_state_nolock()) ffff963622d80800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383506.695464:0:19237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383506.695485:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+6:2400:x1874206966011392:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 273us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383506.695494:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:3.0:1787383506.699530:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383506.699724:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966011648 00000100:00100000:1.0:1787383506.699738:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966011648 00000100:00100000:1.0:1787383506.700239:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:1.0:1787383506.700253:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14899:x1874206966011648:12345-192.168.203.2@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787383506.702177:0:17097:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1790us 00000004:00200000:1.0:1787383506.724536:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787383506.724737:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14899:x1874206966011648:12345-192.168.203.2@tcp:33:mount.lustre.0 Request processed in 24481us (25213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383506.724749:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:3.0:1787383506.913274:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383506.913383:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966011776 00000100:00100000:2.0:1787383506.913395:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966011776 00000100:00100000:2.0:1787383506.913476:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:2.0:1787383506.913486:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14946:x1874206966011776:12345-192.168.203.2@tcp:101:mkdir.0 00010000:00010000:2.0:1787383506.913511:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383506.913546:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532faeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402b24 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383506.913649:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532faf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383506.913666:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532faf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383506.913683:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532faf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383506.913761:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787383506.913804:0:17094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383506.914028:0:17094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532faf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383506.914061:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91532faeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b24 expref: 8 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383506.914088:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532faf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b24 expref: 7 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383506.914098:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9636421d3900) 00010000:00010000:2.0:1787383506.914104:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383506.914108:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7a00, rc 0) 00000100:00100000:2.0:1787383506.914190:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+7:14946:x1874206966011776:12345-192.168.203.2@tcp:101:mkdir.0 Request processed in 705us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383506.914201:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00010000:00010000:1.0:1787383507.611116:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383508.123784:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383508.123814:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984970240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383508.123905:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383508.124000:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984970240 00000100:00100000:3.0:1787383508.124010:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984970240 00000100:00100000:3.0:1787383508.124076:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383508.124086:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984970240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383508.124126:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787383508.124175:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984970240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383508.124183:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787383508.124209:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383508.124249:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984970240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383508.124587:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984970752:0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.124622:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383508.124644:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984971264:0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.124664:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383508.124681:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984971776:0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.124714:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383508.124732:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787383508.124738:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984970368:0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.124813:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383508.124836:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984970880:0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.124881:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383508.124896:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984971392:0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.124914:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383508.124937:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984970752 00000100:00100000:0.0:1787383508.124942:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984970752 00000100:00100000:0.0:1787383508.124967:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984971264 00000100:00100000:0.0:1787383508.124969:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984971264 00000100:00100000:0.0:1787383508.124979:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984971776 00000100:00100000:0.0:1787383508.124982:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984971776 00000100:00100000:0.0:1787383508.125000:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984971392 00000100:00100000:0.0:1787383508.125002:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984971392 00000100:00100000:0.0:1787383508.125017:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787383508.125024:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984970752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.125067:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984970752:12345-0@lo:400:kworker.0 Request processed in 43us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383508.125073:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787383508.125086:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787383508.125091:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984971264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.125116:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984971264:12345-0@lo:400:kworker.0 Request processed in 25us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383508.125122:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787383508.125130:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787383508.125135:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984971776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.125155:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984971776:12345-0@lo:400:kworker.0 Request processed in 21us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383508.125160:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787383508.125168:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787383508.125179:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984971392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.125203:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984971392:12345-0@lo:400:kworker.0 Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383508.125209:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787383508.125267:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984970368 00000100:00100000:0.0:1787383508.125271:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984970368 00000100:00100000:0.0:1787383508.125296:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787383508.125302:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3649:x1874206984970368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.125329:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635036da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3649:x1874206984970368:12345-0@lo:400:kworker.0 Request processed in 28us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383508.125335:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787383508.125378:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984970368:0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.125392:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984971392:0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.125401:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984970752:0@lo:400:kworker.0 00000100:00100000:0.0:1787383508.125409:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984971264:0@lo:400:kworker.0 00010000:00080000:0.0:1787383508.125420:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cbdf80 x1874206984971776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383508.125430:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984971776:0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.125985:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984970496:0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126025:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383508.126051:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984971008:0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126076:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383508.126093:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984971520:0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126114:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383508.126133:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787383508.126139:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984970624:0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383508.126173:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984971136:0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126193:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383508.126206:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984971648:0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126229:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383508.126254:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984971520 00000100:00100000:1.0:1787383508.126259:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984971520 00000100:00100000:1.0:1787383508.126289:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984971648 00000100:00100000:1.0:1787383508.126292:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984971648 00000100:00100000:1.0:1787383508.126307:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383508.126313:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984971520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126363:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984971520:12345-0@lo:400:kworker.0 Request processed in 50us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383508.126371:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383508.126385:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787383508.126391:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984971648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126418:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984971648:12345-0@lo:400:kworker.0 Request processed in 26us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383508.126424:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787383508.126440:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984970880 00000100:00100000:1.0:1787383508.126444:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984970880 00000100:00100000:1.0:1787383508.126464:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984970496 00000100:00100000:1.0:1787383508.126467:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984970496 00000100:00100000:1.0:1787383508.126479:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787383508.126485:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984970880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126518:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984970880:12345-0@lo:400:kworker.0 Request processed in 33us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383508.126524:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787383508.126535:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787383508.126540:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984970496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126563:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984970496:12345-0@lo:400:kworker.0 Request processed in 23us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383508.126568:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787383508.126598:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984971648:0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126608:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984970496:0@lo:400:kworker.0 00010000:00080000:1.0:1787383508.126619:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cbe680 x1874206984971520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383508.126635:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984971520:0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126665:0:19237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984971008 00000100:00100000:1.0:1787383508.126669:0:19237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984971008 00000100:00100000:1.0:1787383508.126706:0:19237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984970624 00000100:00100000:1.0:1787383508.126709:0:19237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984970624 00000100:00100000:1.0:1787383508.126726:0:19237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984971136 00000100:00100000:1.0:1787383508.126728:0:19237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984971136 00000100:00100000:1.0:1787383508.126742:0:19237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383508.126747:0:19237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984971008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126835:0:19237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984971008:12345-0@lo:400:kworker.0 Request processed in 87us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383508.126842:0:19237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383508.126852:0:19237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383508.126858:0:19237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984970624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.126884:0:19237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984970624:12345-0@lo:400:kworker.0 Request processed in 27us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383508.126892:0:19237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383508.126902:0:19237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383508.126909:0:19237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984971136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383508.126947:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383508.126957:0:19237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984971136:12345-0@lo:400:kworker.0 Request processed in 48us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383508.126962:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984972032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383508.126969:0:19237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383508.126997:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984970624:0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.127011:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984971136:0@lo:400:kworker.0 00000100:00100000:2.0:1787383508.127019:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383508.127026:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984971008:0@lo:400:kworker.0 00000100:00100000:1.0:1787383508.127076:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984970880:0@lo:400:kworker.0 00000100:00100000:2.0:1787383508.127087:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984972032 00000100:00100000:1.0:1787383508.127088:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383508.127093:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984972032 00000100:00100000:1.0:1787383508.127098:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984971904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383508.127128:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383508.127134:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383508.127145:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984972032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787383508.127172:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787383508.127200:0:18604:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787383508.127210:0:18604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787383508.127215:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984972032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383508.127223:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383508.127238:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984971904 00000100:00100000:2.0:1787383508.127241:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984971904 00000100:00100000:2.0:1787383508.127257:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383508.127264:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874206984971904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383508.127275:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787383508.127308:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1874206984971904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383508.127314:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383508.127348:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984972032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383508.127384:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984971904:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787383508.127544:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383508.127550:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383508.127553:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383508.127556:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787383508.641951:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787383509.020701:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787383509.046004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383509.047726:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966011904 00000100:00100000:1.0:1787383509.047741:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966011904 00000100:00080000:3.0:1787383509.047914:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383509.047960:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:1.0:1787383509.047971:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+7:14999:x1874206966011904:12345-192.168.203.2@tcp:41:lfs.0 00000004:00000024:1.0:1787383509.048010:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787383509.048093:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+7:14999:x1874206966011904:12345-192.168.203.2@tcp:41:lfs.0 Request processed in 124us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383509.048099:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:3.0:1787383509.055101:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383509.055196:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966012032 00000100:00100000:2.0:1787383509.055206:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966012032 00000100:00100000:2.0:1787383509.055280:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:2.0:1787383509.055291:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14999:x1874206966012032:12345-192.168.203.2@tcp:41:lfs.0 00000004:00000024:2.0:1787383509.055328:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787383509.055435:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14999:x1874206966012032:12345-192.168.203.2@tcp:41:lfs.0 Request processed in 144us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383509.055455:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00080000:3.0:1787383509.055840:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383509.057870:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383509.058159:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966012160 00000100:00100000:2.0:1787383509.058170:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966012160 00000100:00100000:2.0:1787383509.058239:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:2.0:1787383509.058249:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14999:x1874206966012160:12345-192.168.203.2@tcp:13:lfs.0 00002000:00000024:2.0:1787383509.058274:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787383509.058362:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14999:x1874206966012160:12345-192.168.203.2@tcp:13:lfs.0 Request processed in 115us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383509.058370:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00080000:3.0:1787383509.058443:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383509.063418:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383509.063563:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966012288 00000100:00100000:2.0:1787383509.063573:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966012288 00000100:00100000:2.0:1787383509.063751:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1787383509.063762:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14999:x1874206966012288:12345-192.168.203.2@tcp:13:lfs.0 00002000:00000024:2.0:1787383509.063818:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1787383509.064110:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383509.064175:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eeae0f85-81db-4a53-adaf-9a6519b93273+6:14999:x1874206966012288:12345-192.168.203.2@tcp:13:lfs.0 Request processed in 414us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383509.064184:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000001:00100000:0.0:1787383509.162864:0:18596:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eeae0f85-81db-4a53-adaf-9a6519b93273 00000001:00100000:2.0:1787383509.164954:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eeae0f85-81db-4a53-adaf-9a6519b93273 00000001:00080000:2.0:1787383509.164973:0:19416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1787383509.282187:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383509.282268:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966012416 00000100:00100000:3.0:1787383509.282279:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966012416 00000100:00100000:3.0:1787383509.282335:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 130 00000100:00100000:3.0:1787383509.282344:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+10:15029:x1874206966012416:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787383509.282360:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383509.282378:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963600030400/0xc40acec91532faf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402b2b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383509.282407:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963600030400/0xc40acec91532faf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b2b expref: 11 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383509.282419:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963600030400/0xc40acec91532faf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b2b expref: 11 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383509.282429:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030400, rc 0) 00000100:00100000:3.0:1787383509.282485:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635036db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+11:15029:x1874206966012416:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 142us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383509.282492:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 130 00000100:00100000:1.0:1787383509.306031:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383509.306120:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966012544 00000100:00100000:0.0:1787383509.306130:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966012544 00000100:00100000:0.0:1787383509.306197:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 131 00000100:00100000:0.0:1787383509.306208:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+11:15029:x1874206966012544:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787383509.306371:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635036d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+11:15029:x1874206966012544:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 165us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383509.306380:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 131 00000100:00100000:1.0:1787383509.309339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383509.309437:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966012672 00000100:00100000:0.0:1787383509.309447:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966012672 00000100:00100000:0.0:1787383509.309505:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 132 00000100:00100000:0.0:1787383509.309514:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+11:15029:x1874206966012672:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787383509.309742:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+11:15029:x1874206966012672:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 228us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383509.309750:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 132 00000100:00100000:1.0:1787383509.322617:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383509.327009:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966012800 00000100:00100000:3.0:1787383509.327025:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966012800 00000100:00100000:3.0:1787383509.327165:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:3.0:1787383509.327175:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+11:15038:x1874206966012800:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787383509.327333:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+11:15038:x1874206966012800:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 159us (4725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383509.327348:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:1.0:1787383509.353864:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383509.353960:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966012928 00000100:00100000:0.0:1787383509.353970:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966012928 00000100:00100000:0.0:1787383509.354029:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:0.0:1787383509.354039:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+11:15038:x1874206966012928:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383509.354186:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+11:15038:x1874206966012928:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 148us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383509.354194:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:1.0:1787383509.360555:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383509.360810:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966013056 00000100:00100000:3.0:1787383509.360820:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966013056 00000100:00100000:3.0:1787383509.360875:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:3.0:1787383509.360885:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+11:15038:x1874206966013056:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787383509.361037:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+11:15038:x1874206966013056:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 152us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383509.361046:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:1.0:1787383509.369793:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383509.369893:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966013184 00000100:00100000:2.0:1787383509.369904:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966013184 00000100:00100000:2.0:1787383509.369962:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 136 00000100:00100000:2.0:1787383509.369972:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+11:15029:x1874206966013184:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787383509.369987:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383509.370006:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636421f7200/0xc40acec91532fb00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402b5c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383509.370049:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636421f7200/0xc40acec91532fb00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b5c expref: 12 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383509.370061:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636421f7200/0xc40acec91532fb00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b5c expref: 12 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383509.370071:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7200, rc 0) 00000100:00100000:2.0:1787383509.370126:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+12:15029:x1874206966013184:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 155us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383509.370133:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 136 00000100:00100000:1.0:1787383509.375808:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383509.375899:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966013312 00000100:00100000:0.0:1787383509.375910:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966013312 00000100:00100000:0.0:1787383509.375964:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 137 00000100:00100000:0.0:1787383509.375974:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+12:15029:x1874206966013312:12345-192.168.203.2@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787383509.375998:0:17089:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787383509.376019:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787383509.376028:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787383509.376030:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787383509.376033:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787383509.376035:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787383509.379651:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+12:15029:x1874206966013312:12345-192.168.203.2@tcp:256:mount.lustre.0 Request processed in 3667us (3841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383509.379667:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 137 00000100:00100000:1.0:1787383509.384474:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383509.384575:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966013440 00000100:00100000:3.0:1787383509.384585:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966013440 00000100:00100000:3.0:1787383509.384645:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:3.0:1787383509.384655:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+12:15029:x1874206966013440:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787383509.384671:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383509.384701:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963600030c00/0xc40acec91532fb07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402b63 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383509.384732:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963600030c00/0xc40acec91532fb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b63 expref: 13 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383509.384744:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963600030c00/0xc40acec91532fb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b63 expref: 13 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383509.384754:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963600030c00, rc 0) 00000100:00100000:3.0:1787383509.384847:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+13:15029:x1874206966013440:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 192us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383509.384855:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:1.0:1787383509.392597:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383509.392787:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966013568 00000100:00100000:0.0:1787383509.392798:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966013568 00000100:00100000:0.0:1787383509.392866:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00100000:0.0:1787383509.392876:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+13:15029:x1874206966013568:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787383509.393037:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+13:15029:x1874206966013568:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 162us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383509.393045:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00100000:1.0:1787383509.399906:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383509.400012:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966013696 00000100:00100000:2.0:1787383509.400021:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966013696 00000100:00100000:2.0:1787383509.400077:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 140 00000100:00100000:2.0:1787383509.400086:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+13:15029:x1874206966013696:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787383509.400230:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+13:15029:x1874206966013696:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 145us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383509.400239:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 140 00000100:00100000:1.0:1787383509.403209:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383509.403300:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966013824 00000100:00100000:3.0:1787383509.403310:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966013824 00000100:00100000:3.0:1787383509.403366:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 141 00000100:00100000:3.0:1787383509.403376:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+13:15042:x1874206966013824:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787383509.403538:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+13:15042:x1874206966013824:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 163us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383509.403548:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 141 00000100:00100000:1.0:1787383509.414625:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383509.418735:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966013952 00000100:00100000:0.0:1787383509.418751:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966013952 00000100:00100000:0.0:1787383509.418887:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00100000:0.0:1787383509.418897:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+13:15042:x1874206966013952:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383509.419063:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+13:15042:x1874206966013952:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 167us (4448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383509.419071:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00100000:1.0:1787383509.428869:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383509.428903:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383509.428926:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383509.428947:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383509.428971:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383509.428997:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383509.429025:0:19237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966015104 00000100:00100000:1.0:1787383509.429036:0:19237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966015104 00000100:00100000:1.0:1787383509.429084:0:19237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966014976 00000100:00100000:1.0:1787383509.429088:0:19237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966014976 00000100:00100000:1.0:1787383509.429109:0:19237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:1.0:1787383509.429118:0:19237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2401:x1874206966015104:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383509.429189:0:19237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2401:x1874206966015104:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 70us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383509.429197:0:19237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:1.0:1787383509.429213:0:19237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:1.0:1787383509.429219:0:19237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2401:x1874206966014976:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383509.429242:0:19237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2401:x1874206966014976:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 24us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383509.429248:0:19237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:2.0:1787383509.429474:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966014080 00000100:00100000:2.0:1787383509.429479:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966014080 00000100:00100000:2.0:1787383509.429495:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966014336 00000100:00100000:2.0:1787383509.429497:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966014336 00000100:00100000:2.0:1787383509.429504:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966014848 00000100:00100000:2.0:1787383509.429505:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966014848 00000100:00100000:2.0:1787383509.429520:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966014720 00000100:00100000:2.0:1787383509.429523:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966014720 00000100:00100000:2.0:1787383509.429536:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:2.0:1787383509.429542:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+6:2401:x1874206966014848:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383509.429585:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+6:2401:x1874206966014848:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 43us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383509.429592:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:2.0:1787383509.429605:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:2.0:1787383509.429612:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+7:2401:x1874206966014720:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383509.429651:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+7:2401:x1874206966014720:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 40us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383509.429658:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:2.0:1787383509.429671:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383509.429676:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1874206966014080:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787383509.429713:0:17094:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 8c365b90-f012-43f1-ab8b-e2f9eb08095c@192.168.203.2@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1787383509.429750:0:17094:0:(genops.c:1406:class_connect()) connect: client 8c365b90-f012-43f1-ab8b-e2f9eb08095c, cookie 0xc40acec91532fb0e 00000004:00100000:2.0:1787383509.429800:0:17094:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787383509.429898:0:17094:0:(import.c:65:import_set_state_nolock()) ffff963622d84000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383509.429928:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2400:x1874206966014080:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 250us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383509.429935:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383509.429949:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:2.0:1787383509.429954:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1874206966014336:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787383509.429968:0:17094:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 8c365b90-f012-43f1-ab8b-e2f9eb08095c@192.168.203.2@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1787383509.430006:0:17094:0:(genops.c:1406:class_connect()) connect: client 8c365b90-f012-43f1-ab8b-e2f9eb08095c, cookie 0xc40acec91532fb15 00000004:00100000:2.0:1787383509.430019:0:17094:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787383509.430075:0:17094:0:(import.c:65:import_set_state_nolock()) ffff9636082d9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383509.430108:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2400:x1874206966014336:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 153us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383509.430115:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:2.0:1787383509.449427:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383509.449465:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383509.449881:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966014464 00000100:00100000:0.0:1787383509.449891:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966014464 00000100:00100000:0.0:1787383509.449955:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966014208 00000100:00100000:0.0:1787383509.449958:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966014208 00000100:00100000:0.0:1787383509.449986:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1787383509.449996:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:0:x1874206966014464:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787383509.450038:0:19236:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787383509.450101:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:0:x1874206966014464:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 105us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383509.450108:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1787383509.450126:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1787383509.450133:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:0:x1874206966014208:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787383509.450145:0:19236:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787383509.450172:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:0:x1874206966014208:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 41us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383509.450179:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00080000:0.0:1787383509.450215:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383509.450219:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383509.450559:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383509.450658:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966014592 00000100:00100000:0.0:1787383509.450662:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966014592 00000100:00100000:0.0:1787383509.450699:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:0.0:1787383509.450707:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:15029:x1874206966014592:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787383509.450720:0:19236:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787383509.450745:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:15029:x1874206966014592:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 40us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383509.450752:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:1.0:1787383509.468416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383509.468521:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966015232 00000100:00100000:0.0:1787383509.468531:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966015232 00000100:00100000:0.0:1787383509.468604:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:0.0:1787383509.468615:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:15029:x1874206966015232:12345-192.168.203.2@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787383509.468719:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:15029:x1874206966015232:12345-192.168.203.2@tcp:40:mount.lustre.0 Request processed in 105us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383509.468741:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:2.0:1787383509.477600:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383509.477657:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383509.477743:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383509.477859:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966015360 00000100:00100000:3.0:1787383509.477870:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966015360 00000100:00100000:3.0:1787383509.477912:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966015488 00000100:00100000:3.0:1787383509.477915:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966015488 00000100:00100000:3.0:1787383509.477933:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:3.0:1787383509.477940:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1874206966015360:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787383509.477978:0:18600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 8c365b90-f012-43f1-ab8b-e2f9eb08095c@192.168.203.2@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:3.0:1787383509.478008:0:18600:0:(genops.c:1406:class_connect()) connect: client 8c365b90-f012-43f1-ab8b-e2f9eb08095c, cookie 0xc40acec91532fb1c 00002000:00100000:3.0:1787383509.478019:0:18600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8c365b90-f012-43f1-ab8b-e2f9eb08095c/ffff96363cd58000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787383509.478029:0:18600:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787383509.478111:0:18600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787383509.478140:0:18600:0:(import.c:65:import_set_state_nolock()) ffff96363cd5d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383509.478201:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2400:x1874206966015360:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 259us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383509.478209:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:3.0:1787383509.478226:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:3.0:1787383509.478231:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2400:x1874206966015488:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787383509.478264:0:18600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8c365b90-f012-43f1-ab8b-e2f9eb08095c@192.168.203.2@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:3.0:1787383509.478291:0:18600:0:(genops.c:1406:class_connect()) connect: client 8c365b90-f012-43f1-ab8b-e2f9eb08095c, cookie 0xc40acec91532fb23 00002000:00100000:3.0:1787383509.478298:0:18600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8c365b90-f012-43f1-ab8b-e2f9eb08095c/ffff96363ca40000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787383509.478305:0:18600:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787383509.478350:0:18600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787383509.478365:0:18600:0:(import.c:65:import_set_state_nolock()) ffff96363ca46000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383509.478403:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2400:x1874206966015488:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 169us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383509.478410:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1787383509.479176:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966015616 00000100:00100000:0.0:1787383509.479183:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966015616 00000100:00100000:0.0:1787383509.479230:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:0.0:1787383509.479238:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:15029:x1874206966015616:12345-192.168.203.2@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787383509.479293:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:15029:x1874206966015616:12345-192.168.203.2@tcp:900:mount.lustre.0 Request processed in 55us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383509.479300:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:2.0:1787383509.485034:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383509.485370:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966015744 00000100:00100000:0.0:1787383509.485400:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966015744 00000100:00100000:0.0:1787383509.485479:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:0.0:1787383509.485509:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:15029:x1874206966015744:12345-192.168.203.2@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787383509.485634:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787383509.485826:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:15029:x1874206966015744:12345-192.168.203.2@tcp:33:mount.lustre.0 Request processed in 336us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383509.485844:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:3.0:1787383509.659123:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383509.659162:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984972160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383509.659258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383509.660368:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984972160 00000100:00100000:1.0:1787383509.660381:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984972160 00000100:00100000:1.0:1787383509.660448:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787383509.660458:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984972160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383509.660495:0:18604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787383509.660580:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984972160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383509.660602:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383509.660891:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984972160:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787383509.661551:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383509.680288:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383509.680406:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966015872 00000100:00100000:3.0:1787383509.680417:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966015872 00000100:00100000:3.0:1787383509.680486:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1787383509.680496:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:15065:x1874206966015872:12345-192.168.203.2@tcp:101:mkdir.0 00010000:00010000:3.0:1787383509.680517:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383509.680542:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96360516ca00/0xc40acec91532fb2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402b94 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383509.680606:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fb31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383509.680619:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fb31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383509.680632:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fb31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383509.680704:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787383509.680708:0:17095:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383509.680730:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fb31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383509.680755:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96360516ca00/0xc40acec91532fb2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b94 expref: 8 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383509.680805:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fb31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b94 expref: 7 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383509.680815:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9636421d3900) 00010000:00010000:3.0:1787383509.680818:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383509.680822:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0600, rc 0) 00000100:00100000:3.0:1787383509.681054:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+7:15065:x1874206966015872:12345-192.168.203.2@tcp:101:mkdir.0 Request processed in 559us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383509.681062:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1787383510.688336:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383510.688357:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984972288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383510.688417:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383510.688501:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984972288 00000100:00100000:1.0:1787383510.688508:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984972288 00000100:00100000:1.0:1787383510.688568:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787383510.688578:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984972288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383510.688611:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787383510.689292:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984972288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 713us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383510.689301:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1787383510.689505:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383510.690790:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383510.690810:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984972416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383510.690865:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383510.693416:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984972416 00000100:00100000:1.0:1787383510.693430:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984972416 00000100:00100000:1.0:1787383510.693495:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787383510.693504:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984972416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383510.693551:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787383510.693637:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984972416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (2771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383510.693645:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787383510.693710:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984972416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383510.697499:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984972288:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787383511.451369:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787383511.708581:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787383511.708938:0:17074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8c365b90-f012-43f1-ab8b-e2f9eb08095c 00000001:00100000:1.0:1787383511.708950:0:17074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eeae0f85-81db-4a53-adaf-9a6519b93273 00000001:00100000:2.0:1787383511.716551:0:17827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8c365b90-f012-43f1-ab8b-e2f9eb08095c 00000001:00100000:2.0:1787383511.716569:0:17827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of eeae0f85-81db-4a53-adaf-9a6519b93273 00010000:00010000:3.0:1787383512.731092:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787383512.863366:0:19974:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787383513.243065:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98408fb2-7fed-492b-911f-46eabbf1f8e3:3647:1874206984972544:0@lo:400:kworker.0 00000100:00100000:1.0:1787383513.243141:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383513.243225:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984972544 00000100:00100000:2.0:1787383513.243233:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984972544 00000100:00100000:2.0:1787383513.243282:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787383513.243291:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3647:x1874206984972544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383513.243705:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984972672:0@lo:400:kworker.0 00000100:00100000:3.0:1787383513.243739:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383513.243966:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984972800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383513.244007:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383513.244150:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984972800 00000100:00100000:3.0:1787383513.244155:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984972800 00000100:00100000:3.0:1787383513.244194:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383513.244202:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984972800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383513.244224:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787383513.244260:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984972800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383513.244268:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787383513.244287:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383513.244322:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984972800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383513.244367:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984972672 00000100:00100000:3.0:1787383513.244371:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984972672 00000100:00100000:3.0:1787383513.244397:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787383513.244404:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984972672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383513.244442:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984972672:12345-0@lo:400:kworker.0 Request processed in 38us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383513.244448:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787383513.244475:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984972672:0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.249311:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3647:x1874206984972544:12345-0@lo:400:kworker.0 Request processed in 6011us (6160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383513.249327:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787383513.249442:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984972928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383513.249491:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383513.249532:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984972928 00000100:00100000:2.0:1787383513.249539:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984972928 00000100:00100000:2.0:1787383513.249604:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383513.249614:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984972928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787383513.249643:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787383513.249708:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984972928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383513.249714:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383513.249755:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984972928:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787383513.249792:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383513.250065:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984973440:0@lo:400:kworker.0 00000100:00100000:0.0:1787383513.250095:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383513.250115:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984973952:0@lo:400:kworker.0 00000100:00100000:0.0:1787383513.250137:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383513.250164:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787383513.250170:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984973312:0@lo:400:kworker.0 00000100:00100000:0.0:1787383513.250196:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383513.250214:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984973824:0@lo:400:kworker.0 00000100:00100000:0.0:1787383513.250236:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383513.250259:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984973440 00000100:00100000:0.0:1787383513.250263:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984973440 00000100:00100000:0.0:1787383513.250300:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383513.250307:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984973440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383513.250343:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984973440:12345-0@lo:400:kworker.0 Request processed in 36us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383513.250349:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383513.250368:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984973952 00000100:00100000:0.0:1787383513.250371:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984973952 00000100:00100000:0.0:1787383513.250396:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984973824 00000100:00100000:0.0:1787383513.250399:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984973824 00000100:00100000:0.0:1787383513.250418:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787383513.250424:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984973952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383513.250452:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984973952:12345-0@lo:400:kworker.0 Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383513.250459:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787383513.250470:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787383513.250475:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984973824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383513.250498:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206984973824:12345-0@lo:400:kworker.0 Request processed in 23us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383513.250503:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787383513.250519:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984973312 00000100:00100000:0.0:1787383513.250528:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984973312 00000100:00100000:0.0:1787383513.250553:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787383513.250559:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984973312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383513.252074:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984973312:12345-0@lo:400:kworker.0 Request processed in 1509us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383513.252085:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787383513.252123:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383513.252128:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383513.252131:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383513.252168:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984973312:0@lo:400:kworker.0 00010000:00080000:0.0:1787383513.252182:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cbfb80 x1874206984973824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383513.252193:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984973824:0@lo:400:kworker.0 00000100:00100000:0.0:1787383513.252203:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984973440:0@lo:400:kworker.0 00000100:00100000:0.0:1787383513.252212:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984973952:0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.252444:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984973184:0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.252483:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383513.252517:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984973696:0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.252541:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383513.252558:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984974208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383513.252589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383513.252610:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787383513.252617:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984973056:0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.252639:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383513.252668:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984973568:0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.252689:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383513.252704:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984974080:0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.252724:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383513.252749:0:19676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984973056 00000100:00100000:2.0:1787383513.252754:0:19676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984973056 00000100:00100000:2.0:1787383513.252836:0:19676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383513.252843:0:19676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984973056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.252885:0:19676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984973056:12345-0@lo:400:kworker.0 Request processed in 41us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383513.252891:0:19676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383513.252924:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984973184 00000100:00100000:2.0:1787383513.252927:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984973184 00000100:00100000:2.0:1787383513.252942:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984973696 00000100:00100000:2.0:1787383513.252945:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984973696 00000100:00100000:2.0:1787383513.252957:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984973568 00000100:00100000:2.0:1787383513.252960:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984973568 00000100:00100000:2.0:1787383513.252970:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984974080 00000100:00100000:2.0:1787383513.252972:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984974080 00000100:00100000:2.0:1787383513.252985:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787383513.252991:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984973184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.253020:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984973184:12345-0@lo:400:kworker.0 Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383513.253026:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787383513.253037:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787383513.253043:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984973696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.253066:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206984973696:12345-0@lo:400:kworker.0 Request processed in 24us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383513.253072:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787383513.253083:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787383513.253088:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984973568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.253114:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984973568:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383513.253120:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787383513.253131:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787383513.253136:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984974080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.253167:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984974080:12345-0@lo:400:kworker.0 Request processed in 31us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383513.253181:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787383513.253203:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984974208 00000100:00100000:2.0:1787383513.253206:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984974208 00000100:00100000:2.0:1787383513.253227:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383513.253232:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984974208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383513.253246:0:18604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787383513.253274:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984974208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383513.253280:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787383513.253299:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383513.253302:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383513.253304:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383513.253322:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1787383513.253336:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984973056:0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.253347:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984973568:0@lo:400:kworker.0 00010000:00080000:2.0:1787383513.253357:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503cbf100 x1874206984974080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383513.253367:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984974080:0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.253375:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984973184:0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.253384:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206984973696:0@lo:400:kworker.0 00000100:00100000:2.0:1787383513.253398:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984974208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383513.254061:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98408fb2-7fed-492b-911f-46eabbf1f8e3:3647:1874206984972544:0@lo:400:kworker.0 00010000:00010000:2.0:1787383513.754929:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383514.676643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383514.676714:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383514.676749:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383514.676793:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966016256 00000100:00100000:3.0:1787383514.676804:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966016256 00000100:00100000:2.0:1787383514.676810:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383514.676849:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383514.676864:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966016768 00000100:00100000:3.0:1787383514.676868:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966016768 00000100:00100000:2.0:1787383514.676874:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383514.676892:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966016128 00000100:00100000:1.0:1787383514.676893:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966016512 00000100:00100000:3.0:1787383514.676897:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966016128 00000100:00100000:1.0:1787383514.676899:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966016512 00000100:00100000:2.0:1787383514.676902:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383514.676927:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:2.0:1787383514.676928:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383514.676938:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966017024 00000100:00100000:1.0:1787383514.676942:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966017024 00000100:00100000:3.0:1787383514.676943:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966016256:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383514.676958:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383514.676960:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966016384 00000100:00100000:1.0:1787383514.676962:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966016384 00000100:00100000:2.0:1787383514.676975:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966016640 00000100:00100000:1.0:1787383514.676976:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966016896 00000100:00100000:2.0:1787383514.676978:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966016640 00000100:00100000:1.0:1787383514.676978:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966016896 00000100:00100000:1.0:1787383514.676993:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:2.0:1787383514.676999:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:1.0:1787383514.677001:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966016512:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383514.677005:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2402:x1874206966016768:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383514.677031:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966016256:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 92us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383514.677041:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2402:x1874206966016768:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 34us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383514.677042:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:2.0:1787383514.677054:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:3.0:1787383514.677070:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:3.0:1787383514.677079:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+6:2402:x1874206966016128:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383514.677105:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+6:2402:x1874206966016128:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383514.677125:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966016000 00000100:00100000:0.0:1787383514.677131:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966016000 00000100:00100000:0.0:1787383514.677160:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:0.0:1787383514.677167:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+13:2402:x1874206966016000:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383514.677194:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+13:2402:x1874206966016000:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 28us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383514.677200:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:0.0:1787383514.677229:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:0.0:1787383514.677236:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2402:x1874206966017024:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383514.677315:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966016512:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 315us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383514.677323:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:1.0:1787383514.677336:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:1.0:1787383514.677353:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966016384:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383514.677378:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966016384:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 36us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383514.677384:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:1.0:1787383514.677395:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:1.0:1787383514.677400:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2402:x1874206966016896:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383514.677423:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2402:x1874206966016896:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383514.677428:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:2.0:1787383514.677472:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:2.0:1787383514.677481:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2402:x1874206966016640:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383514.677520:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2402:x1874206966016640:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 40us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383514.677527:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00080000:2.0:1787383514.677575:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383514.677580:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383514.677582:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383514.677584:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383514.677906:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2402:x1874206966017024:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 668us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383514.677913:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:3.0:1787383514.685020:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00010000:00010000:0.0:1787383514.778963:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383514.779421:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984974336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383514.779511:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383514.779574:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984974336 00000100:00100000:0.0:1787383514.779582:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984974336 00000100:00100000:0.0:1787383514.779637:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383514.779645:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984974336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787383514.779677:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787383514.779718:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984974336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383514.779726:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383514.779795:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984974336:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1787383514.784402:0:18596:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8c365b90-f012-43f1-ab8b-e2f9eb08095c 00000001:00100000:1.0:1787383514.785352:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c365b90-f012-43f1-ab8b-e2f9eb08095c 00010000:00010000:3.0:1787383515.803015:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383515.803998:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984974464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383515.804068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383515.804447:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984974464 00000100:00100000:3.0:1787383515.804455:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984974464 00000100:00100000:3.0:1787383515.804516:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787383515.804527:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984974464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787383515.804565:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787383515.804628:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984974592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383515.804682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383515.804714:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984974592 00000100:00100000:1.0:1787383515.804719:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984974592 00000100:00100000:1.0:1787383515.804738:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787383515.804748:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984974592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383515.804791:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787383515.804823:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984974592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383515.804830:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787383515.804868:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984974592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383515.810085:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984974464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5550us (6006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383515.810100:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787383515.811657:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984974464:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1787383516.166472:0:20122:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff118b2d60 00000020:00000080:0.0:1787383516.166489:0:20122:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787383516.166494:0:20122:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787383516.166514:0:20122:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff118b4ff0 20000000:00000080:0.0:1787383516.166523:0:20122:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9636082eb800 uarg=0000000000000000 20000000:01000000:0.0:1787383516.166568:0:20122:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787383516.166574:0:20122:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787383516.166579:0:20122:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787383516.172657:0:20123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787383516.172947:0:20122:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787383516.181319:0:20122:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787383516.181350:0:20122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.181384:0:20122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96360516ce00/0xc40acec91532f7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f7c6 expref: 23 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.181393:0:20122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c9a00/0xc40acec91532f7db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f7d4 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.181400:0:20122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963600030600/0xc40acec91532f81a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f813 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.181407:0:20122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96360516d600/0xc40acec91532f8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532f8ad expref: 23 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.181416:0:20122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963600031e00/0xc40acec91532fac8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402af3 expref: 12 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.181424:0:20122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963600030c00/0xc40acec91532fb07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b63 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.181431:0:20122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.181473:0:20122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963600030c00/0xc40acec91532fb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b63 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.181489:0:20122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff963600030c00/0xc40acec91532fb07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b63 expref: 12 pid: 17088 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383516.181504:0:20122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20122:1874206984974720:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383516.181707:0:20122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963600031e00/0xc40acec91532fac8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402af3 expref: 12 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.181722:0:20122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff963600031e00/0xc40acec91532fac8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402af3 expref: 12 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383516.181732:0:20122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20122:1874206984974848:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383516.181986:0:20122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96360516d600/0xc40acec91532f8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532f8ad expref: 23 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.181996:0:20122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96360516d600/0xc40acec91532f8b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532f8ad expref: 23 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383516.182007:0:20122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20122:1874206984974976:0@lo:104: 00000100:00100000:0.0:1787383516.182051:0:20122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383516.182087:0:20122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963600030600/0xc40acec91532f81a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532f813 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.182095:0:20122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff963600030600/0xc40acec91532f81a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532f813 expref: 23 pid: 17089 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383516.182103:0:20122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20122:1874206984975104:0@lo:104: 00000100:00100000:0.0:1787383516.182124:0:20122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383516.182245:0:20122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c9a00/0xc40acec91532f7db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532f7d4 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.182254:0:20122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636113c9a00/0xc40acec91532f7db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532f7d4 expref: 23 pid: 17089 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383516.182262:0:20122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20122:1874206984975232:0@lo:104: 00000100:00100000:0.0:1787383516.182286:0:20122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383516.182739:0:20122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96360516ce00/0xc40acec91532f7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532f7c6 expref: 23 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.182749:0:20122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96360516ce00/0xc40acec91532f7cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532f7c6 expref: 23 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383516.182758:0:20122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20122:1874206984975360:0@lo:104: 00000100:00100000:0.0:1787383516.182810:0:20122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383516.182913:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984974976 00000100:00100000:3.0:1787383516.182920:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984974976 00000100:00100000:3.0:1787383516.182958:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984975104 00000100:00100000:3.0:1787383516.182961:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984975104 00000100:00100000:3.0:1787383516.182974:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984975232 00000100:00100000:3.0:1787383516.182976:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984975232 00000100:00100000:3.0:1787383516.182988:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383516.182996:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+5:20122:x1874206984974976:12345-0@lo:104: 00010000:00010000:3.0:1787383516.183008:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f8b4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183063:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787383516.183070:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+5:20122:x1874206984974976:12345-0@lo:104: Request processed in 74us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383516.183077:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383516.183094:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383516.183100:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+4:20122:x1874206984975104:12345-0@lo:104: 00010000:00010000:3.0:1787383516.183108:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f81a expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183138:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787383516.183143:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+4:20122:x1874206984975104:12345-0@lo:104: Request processed in 44us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383516.183148:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383516.183159:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383516.183165:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:20122:x1874206984975232:12345-0@lo:104: 00010000:00010000:3.0:1787383516.183172:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f7db expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183203:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787383516.183208:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:20122:x1874206984975232:12345-0@lo:104: Request processed in 44us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383516.183214:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787383516.183228:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787383516.183234:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f8b4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183252:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383516.183256:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532f8b4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183264:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532f8b4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383516.183271:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532f8b4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383516.183276:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383516.183304:0:18626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f8b4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183310:0:18626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383516.183330:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f8b4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183337:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963600030800/0xc40acec91532f8ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f8b4 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183350:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383516.183353:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f81a expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183359:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17400 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383516.183361:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532f81a expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183377:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532f81a expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383516.183383:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532f81a expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383516.183388:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383516.183401:0:18626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f81a expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183407:0:18626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383516.183422:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f81a expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183428:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963610f17400/0xc40acec91532f813 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f81a expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183436:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383516.183440:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f7db expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183445:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96360516c600 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383516.183448:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532f7db expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183454:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532f7db expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383516.183459:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532f7db expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383516.183469:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383516.183482:0:18626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f7db expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183487:0:18626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383516.183493:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f7db expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183499:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff96360516c600/0xc40acec91532f7d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f7db expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.183506:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383516.183508:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383516.183509:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383516.183516:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383516.183522:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383516.183539:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984975488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383516.183567:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383516.183732:0:20122:0:(client.c:2702:ptlrpc_set_wait()) set ffff963601254540 going to sleep for 11 seconds 00000100:00100000:0.0:1787383516.183753:0:20122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20122:1874206984974976:0@lo:104: 00000100:00100000:0.0:1787383516.183761:0:20122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20122:1874206984975104:0@lo:104: 00000100:00100000:0.0:1787383516.183795:0:20122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20122:1874206984975232:0@lo:104: 00000100:00100000:3.0:1787383516.183885:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350206ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984975616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383516.183910:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383516.183928:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383516.183933:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984975744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383516.183951:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383516.183977:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984975488 00000100:00100000:3.0:1787383516.183981:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984975488 00010000:00010000:3.0:1787383516.184000:0:17079:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96360516d600/0xc40acec91532f8b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f8ad expref: 24 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383516.184026:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984975616 00000100:00100000:3.0:1787383516.184029:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984975616 00010000:00010000:3.0:1787383516.184040:0:17079:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963600030600/0xc40acec91532f81a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f813 expref: 25 pid: 17089 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383516.184049:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984975744 00000100:00100000:3.0:1787383516.184051:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984975744 00010000:00010000:3.0:1787383516.184060:0:17079:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c9a00/0xc40acec91532f7db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f7d4 expref: 26 pid: 17089 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383516.184071:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383516.184077:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+26:3648:x1874206984975488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383516.184086:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383516.184091:0:17079:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96360516d600/0xc40acec91532f8b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f8ad expref: 26 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.184101:0:17079:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96360516d600/0xc40acec91532f8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532f8ad expref: 26 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.184114:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96360516d600/0xc40acec91532f8b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532f8ad expref: 26 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.184127:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383516.184155:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+25:3648:x1874206984975488:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383516.184162:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383516.184175:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383516.184181:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3649:x1874206984975616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383516.184197:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383516.184201:0:17079:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963600030600/0xc40acec91532f81a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f813 expref: 24 pid: 17089 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.184209:0:17079:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963600030600/0xc40acec91532f81a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532f813 expref: 24 pid: 17089 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.184219:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963600030600/0xc40acec91532f81a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532f813 expref: 24 pid: 17089 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.184228:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383516.184252:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:3649:x1874206984975616:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383516.184258:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383516.184272:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383516.184277:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:3649:x1874206984975744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383516.184285:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383516.184289:0:17079:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c9a00/0xc40acec91532f7db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f7d4 expref: 22 pid: 17089 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.184296:0:17079:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c9a00/0xc40acec91532f7db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532f7d4 expref: 22 pid: 17089 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.184306:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9a00/0xc40acec91532f7db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532f7d4 expref: 22 pid: 17089 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.184314:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383516.184336:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:3649:x1874206984975744:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383516.184351:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383516.184380:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984975744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383516.184386:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350206ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984975616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383516.184407:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984975488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383516.184421:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984975360 00000100:00100000:3.0:1787383516.184424:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984975360 00000100:00100000:3.0:1787383516.184439:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383516.184444:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:20122:x1874206984975360:12345-0@lo:104: 00010000:00010000:3.0:1787383516.184452:0:17078:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f7cd expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.184486:0:17078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787383516.184490:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+3:20122:x1874206984975360:12345-0@lo:104: Request processed in 47us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383516.184496:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787383516.184508:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383516.184512:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532f7cd expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.184519:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16400 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383516.184522:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532f7cd expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.184529:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532f7cd expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383516.184545:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532f7cd expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383516.184550:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787383516.184569:0:18626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f7cd expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.184574:0:18626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787383516.184834:0:20122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20122:1874206984975360:0@lo:104: 00010000:00010000:3.0:1787383516.185168:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f7cd expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.185177:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963610f16400/0xc40acec91532f7c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532f7cd expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.185192:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383516.185193:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383516.185195:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383516.185207:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383516.185216:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984975872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383516.185248:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383516.185278:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984975872 00000100:00100000:3.0:1787383516.185282:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984975872 00010000:00010000:3.0:1787383516.185300:0:17079:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96360516ce00/0xc40acec91532f7cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f7c6 expref: 21 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383516.185319:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383516.185325:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:3648:x1874206984975872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383516.185334:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383516.185346:0:17079:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96360516ce00/0xc40acec91532f7cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532f7c6 expref: 21 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.185354:0:17079:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96360516ce00/0xc40acec91532f7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532f7c6 expref: 21 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.185364:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96360516ce00/0xc40acec91532f7cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532f7c6 expref: 21 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383516.185374:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383516.185401:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:3648:x1874206984975872:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383516.185406:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787383516.185431:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984975872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383516.189192:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383516.189270:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383516.189498:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966017152 00000100:00100000:3.0:1787383516.189509:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966017152 00010000:00010000:3.0:1787383516.189546:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963600031e00/0xc40acec91532fac8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402af3 expref: 13 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383516.189622:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966017280 00000100:00100000:3.0:1787383516.189626:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966017280 00010000:00010000:3.0:1787383516.189650:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963600030c00/0xc40acec91532fb07 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b63 expref: 14 pid: 17088 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383516.189891:0:20122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20122:1874206984974848:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383516.189903:0:20122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20122:1874206984974720:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383516.189935:0:20122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383516.190055:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:2.0:1787383516.190068:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963605015c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+14:2401:x1874206966017152:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383516.190083:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383516.190090:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963600031e00/0xc40acec91532fac8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402af3 expref: 14 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190101:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963600031e00/0xc40acec91532fac8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402af3 expref: 14 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190118:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963600031e00/0xc40acec91532fac8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402af3 expref: 14 pid: 17086 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190133:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383516.190185:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963605015c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+13:2401:x1874206966017152:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 120us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383516.190193:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:2.0:1787383516.190238:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:2.0:1787383516.190245:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+12:2401:x1874206966017280:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383516.190253:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383516.190258:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963600030c00/0xc40acec91532fb07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b63 expref: 12 pid: 17088 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190268:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963600030c00/0xc40acec91532fb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b63 expref: 12 pid: 17088 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190277:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963600030c00/0xc40acec91532fb07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b63 expref: 12 pid: 17088 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190306:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190313:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190327:0:17081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190335:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190342:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190349:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190355:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac9400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383516.190359:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190367:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190378:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.190386:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383516.190407:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+11:2401:x1874206966017280:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 161us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383516.190419:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00010000:00010000:0.0:1787383516.190801:0:20122:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.190810:0:20122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383516.190816:0:20122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac9400/0xc40acec91532fb38 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383516.826905:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383517.852134:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787383517.980560:0:17091:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383517.980569:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff963620417000 from 13 10000000:01000000:3.0:1787383517.980574:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383517.980622:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.980646:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.980672:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383517.980697:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383517.980803:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383517.980836:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383517.981252:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984976000 00000100:00100000:2.0:1787383517.981261:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984976000 00000100:00100000:2.0:1787383517.981311:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787383517.981321:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:17091:x1874206984976000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383517.981345:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383517.981363:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636421f7000/0xc40acec91532fb46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532fb3f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383517.981385:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636421f7000/0xc40acec91532fb46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532fb3f expref: 21 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383517.981396:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636421f7000/0xc40acec91532fb46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532fb3f expref: 21 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383517.981405:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7000, rc 0) 00000100:00100000:2.0:1787383517.982087:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:17091:x1874206984976000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 766us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383517.982096:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787383517.982187:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383517.982203:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.982214:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383517.982275:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383517.982307:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383517.982349:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383517.983833:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984976128 00000100:00100000:2.0:1787383517.983849:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984976128 00000100:00100000:2.0:1787383517.983904:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787383517.983913:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636352b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:17091:x1874206984976128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383517.984115:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636352b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:17091:x1874206984976128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (1806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383517.984123:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787383517.984402:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383517.984459:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503cbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383517.985325:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383517.985424:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4300 going to sleep for 11 seconds 00000100:00100000:2.0:1787383517.985539:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984976256 00000100:00100000:2.0:1787383517.985545:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984976256 00000100:00100000:2.0:1787383517.985591:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787383517.985600:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:17091:x1874206984976256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383517.985783:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:17091:x1874206984976256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383517.985791:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787383517.986005:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503cbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787383517.987174:0:20201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787383517.987260:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787383517.987283:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383517.987294:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.987305:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383517.987315:0:17091:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383517.987318:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff963638ad9800 from 13 10000000:01000000:3.0:1787383517.987321:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383517.987363:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.987372:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.987381:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383517.987404:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383517.987455:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383517.987501:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383517.987663:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984976384 00000100:00100000:0.0:1787383517.987669:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984976384 00000100:00100000:0.0:1787383517.987760:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787383517.987806:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:17091:x1874206984976384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383517.987818:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383517.987831:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96363dac9800/0xc40acec91532fb54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532fb4d expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383517.987852:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac9800/0xc40acec91532fb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532fb4d expref: 22 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383517.987862:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96363dac9800/0xc40acec91532fb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532fb4d expref: 22 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383517.987871:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9800, rc 0) 00000100:00100000:0.0:1787383517.987910:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:17091:x1874206984976384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383517.987914:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787383517.988013:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383517.988022:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.988028:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383517.988065:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383517.988083:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383517.988195:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383517.988329:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984976512 00000100:00100000:2.0:1787383517.988334:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984976512 00000100:00100000:2.0:1787383517.988357:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787383517.988364:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:17091:x1874206984976512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383517.988488:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:17091:x1874206984976512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383517.988495:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787383517.988570:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383517.988597:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383517.988649:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383517.988669:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383517.988712:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984976640 00000100:00100000:2.0:1787383517.988716:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984976640 00000100:00100000:2.0:1787383517.988733:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787383517.988739:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:17091:x1874206984976640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383517.988854:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:17091:x1874206984976640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383517.988860:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787383517.988944:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787383517.989963:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787383517.990114:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787383517.990135:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383517.990144:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383517.990155:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383517.990173:0:17091:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787383517.990175:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff963636f5c800 from 13 10000000:01000000:2.0:1787383517.990178:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787383517.990217:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383517.990225:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383517.990233:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383517.990252:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383517.990300:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383517.990336:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383517.990521:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984976768 00000100:00100000:3.0:1787383517.990527:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984976768 00000100:00100000:3.0:1787383517.990556:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787383517.990563:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:17091:x1874206984976768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383517.990573:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383517.990584:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c1600/0xc40acec91532fb62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532fb5b expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.990604:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c1600/0xc40acec91532fb62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532fb5b expref: 23 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.990615:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c1600/0xc40acec91532fb62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532fb5b expref: 23 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.990624:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1600, rc 0) 00000100:00100000:3.0:1787383517.990675:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:17091:x1874206984976768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383517.990682:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787383517.990754:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383517.990798:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383517.990808:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383517.990861:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383517.990887:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383517.990903:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383517.990965:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984976896 00000100:00100000:3.0:1787383517.990969:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984976896 00000100:00100000:3.0:1787383517.990987:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787383517.990992:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:17091:x1874206984976896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383517.991095:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:17091:x1874206984976896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383517.991102:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787383517.991167:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984976896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383517.991193:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984977024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383517.991311:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383517.991338:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383517.991380:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984977024 00000100:00100000:3.0:1787383517.991384:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984977024 00000100:00100000:3.0:1787383517.991407:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787383517.991413:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:17091:x1874206984977024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383517.991503:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:17091:x1874206984977024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383517.991511:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787383517.991661:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984977024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787383517.992444:0:20203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787383517.992679:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787383517.992698:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383517.992707:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.992717:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383517.992728:0:17091:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383517.992731:0:17091:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff963620e92000 from 13 10000000:01000000:3.0:1787383517.992734:0:17091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383517.992800:0:17091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.992808:0:17091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.992816:0:17091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383517.992834:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984977152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383517.992994:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383517.993022:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963604a92cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383517.993094:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984977152 00000100:00100000:2.0:1787383517.993100:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984977152 00000100:00100000:2.0:1787383517.993132:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787383517.993140:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:17091:x1874206984977152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383517.993150:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383517.993163:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636421f6400/0xc40acec91532fb70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532fb69 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383517.993185:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636421f6400/0xc40acec91532fb70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532fb69 expref: 24 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383517.993195:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636421f6400/0xc40acec91532fb70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532fb69 expref: 24 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383517.993388:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f6400, rc 0) 00000100:00100000:2.0:1787383517.993430:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:17091:x1874206984977152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 291us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383517.993437:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787383517.993607:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984977152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383517.993640:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.993650:0:17091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383517.993700:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984977280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383517.993724:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383517.993743:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963604a92cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383517.993794:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984977280 00000100:00100000:2.0:1787383517.993798:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984977280 00000100:00100000:2.0:1787383517.993821:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787383517.993827:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:17091:x1874206984977280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383517.993917:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:17091:x1874206984977280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383517.993929:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787383517.994006:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984977280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383517.994032:0:17091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984977408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383517.994066:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383517.994087:0:17091:0:(client.c:2702:ptlrpc_set_wait()) set ffff963604a92cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383517.994135:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984977408 00000100:00100000:0.0:1787383517.994139:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984977408 00000100:00100000:0.0:1787383517.994164:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787383517.994170:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:17091:x1874206984977408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383517.994332:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:17091:x1874206984977408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383517.994338:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787383517.994392:0:17091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:98408fb2-7fed-492b-911f-46eabbf1f8e3:17091:1874206984977408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787383517.995386:0:20204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787383517.995599:0:17091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787383517.995617:0:17091:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383517.995634:0:17091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383517.995645:0:17091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383518.008960:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383518.009114:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966017408 00000100:00100000:2.0:1787383518.009123:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966017408 00000100:00100000:2.0:1787383518.009206:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 157 00000100:00100000:2.0:1787383518.009217:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+11:14913:x1874206966017408:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383518.009294:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383518.009315:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636421f6c00/0xc40acec91532fb77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402b9b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383518.009343:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636421f6c00/0xc40acec91532fb77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b9b expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383518.009355:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636421f6c00/0xc40acec91532fb77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b9b expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383518.009365:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f6c00, rc 0) 00000100:00100000:2.0:1787383518.009423:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+12:14913:x1874206966017408:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 208us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383518.009431:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 157 00000100:00100000:1.0:1787383518.011853:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383518.011933:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966017536 00000100:00100000:3.0:1787383518.011943:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966017536 00000100:00100000:3.0:1787383518.012001:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 158 00000100:00100000:3.0:1787383518.012009:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+12:14913:x1874206966017536:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383518.012161:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+12:14913:x1874206966017536:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 152us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383518.012169:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 158 00000100:00100000:1.0:1787383518.014835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383518.014951:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966017664 00000100:00100000:2.0:1787383518.014960:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966017664 00000100:00100000:2.0:1787383518.015019:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 159 00000100:00100000:2.0:1787383518.015028:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+12:14913:x1874206966017664:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383518.015165:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+12:14913:x1874206966017664:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 137us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383518.015173:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 159 00000100:00100000:1.0:1787383518.023643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383518.023847:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966017792 00000100:00100000:2.0:1787383518.023857:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966017792 00000100:00100000:2.0:1787383518.023951:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 160 00000100:00100000:2.0:1787383518.023962:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+12:14913:x1874206966017792:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383518.023980:0:17086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383518.023998:0:17086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636421f7600/0xc40acec91532fb7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402ba2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383518.024026:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636421f7600/0xc40acec91532fb7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402ba2 expref: 13 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383518.024037:0:17086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636421f7600/0xc40acec91532fb7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402ba2 expref: 13 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383518.024047:0:17086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7600, rc 0) 00000100:00100000:2.0:1787383518.024107:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+13:14913:x1874206966017792:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 147us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383518.024114:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 160 00000100:00100000:0.0:1787383518.026251:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383518.026421:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966017920 00000100:00100000:1.0:1787383518.026431:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966017920 00000100:00100000:1.0:1787383518.026483:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 161 00000100:00100000:1.0:1787383518.026492:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+13:14913:x1874206966017920:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383518.026655:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+13:14913:x1874206966017920:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 163us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383518.026663:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 161 00000100:00100000:0.0:1787383518.029509:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383518.029581:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966018048 00000100:00100000:1.0:1787383518.029591:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966018048 00000100:00100000:1.0:1787383518.029663:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 162 00000100:00100000:1.0:1787383518.029674:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+13:14913:x1874206966018048:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383518.030111:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+13:14913:x1874206966018048:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 436us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383518.030120:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 162 00000100:00100000:1.0:1787383518.363005:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984977536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383518.363084:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383518.363274:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984977536 00000100:00100000:0.0:1787383518.363282:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984977536 00000100:00100000:0.0:1787383518.363336:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787383518.363345:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984977536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383518.363373:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787383518.364171:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984977664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383518.364207:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383518.364233:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383518.364241:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963502069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984977792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383518.364263:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383518.364289:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984977664 00000100:00100000:3.0:1787383518.364294:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984977664 00000100:00100000:3.0:1787383518.364317:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984977792 00000100:00100000:3.0:1787383518.364320:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984977792 00000100:00100000:3.0:1787383518.364337:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787383518.364343:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984977664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383518.364360:0:18604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787383518.364395:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984977664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383518.364402:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787383518.364417:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787383518.364422:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984977792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383518.364431:0:18604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787383518.364454:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984977792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383518.364460:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787383518.364497:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984977792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383518.364520:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984977664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383518.365135:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984977536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1789us (2048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383518.365144:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787383518.365165:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383518.365169:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383518.365358:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984977920:0@lo:400:kworker.0 00000100:00100000:0.0:1787383518.365393:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383518.365422:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984978432:0@lo:400:kworker.0 00000100:00100000:0.0:1787383518.365445:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383518.365463:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984978944:0@lo:400:kworker.0 00000100:00100000:0.0:1787383518.365484:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383518.365502:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787383518.365507:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984978048:0@lo:400:kworker.0 00000100:00100000:0.0:1787383518.365527:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383518.365543:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984978560:0@lo:400:kworker.0 00000100:00100000:0.0:1787383518.365574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383518.365600:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984978432 00000100:00100000:0.0:1787383518.365605:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984978432 00000100:00100000:0.0:1787383518.365642:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984978944 00000100:00100000:0.0:1787383518.365646:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984978944 00000100:00100000:0.0:1787383518.365665:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984978048 00000100:00100000:0.0:1787383518.365668:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984978048 00000100:00100000:0.0:1787383518.365681:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984978560 00000100:00100000:0.0:1787383518.365684:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984978560 00000100:00100000:0.0:1787383518.365698:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787383518.365705:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984978432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383518.365743:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206984978432:12345-0@lo:400:kworker.0 Request processed in 38us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383518.365750:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787383518.365762:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787383518.365794:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984978944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383518.365822:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984978944:12345-0@lo:400:kworker.0 Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383518.365829:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787383518.365839:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787383518.365845:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984978048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383518.365867:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206984978048:12345-0@lo:400:kworker.0 Request processed in 23us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383518.365872:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787383518.365882:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787383518.365887:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984978560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383518.365910:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984978560:12345-0@lo:400:kworker.0 Request processed in 23us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383518.365922:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1787383518.365944:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383518.365947:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383518.365970:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206984978048:0@lo:400:kworker.0 00000100:00100000:0.0:1787383518.365980:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984978560:0@lo:400:kworker.0 00000100:00100000:0.0:1787383518.365987:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984978432:0@lo:400:kworker.0 00010000:00080000:0.0:1787383518.365998:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636084b5180 x1874206984978944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383518.366007:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984978944:0@lo:400:kworker.0 00000100:00100000:2.0:1787383518.366120:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984977920 00000100:00100000:2.0:1787383518.366125:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984977920 00000100:00100000:2.0:1787383518.366167:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787383518.366175:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984977920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383518.366213:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984977920:12345-0@lo:400:kworker.0 Request processed in 39us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383518.366219:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787383518.366329:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984977920:0@lo:400:kworker.0 00000100:00100000:3.0:1787383518.366432:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984978176:0@lo:400:kworker.0 00000100:00100000:3.0:1787383518.366461:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383518.366518:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984978688:0@lo:400:kworker.0 00000100:00100000:3.0:1787383518.366540:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383518.366559:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787383518.366566:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984978304:0@lo:400:kworker.0 00000100:00100000:3.0:1787383518.366589:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383518.366606:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984978816:0@lo:400:kworker.0 00000100:00100000:3.0:1787383518.366636:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383518.366663:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984978688 00000100:00100000:3.0:1787383518.366666:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984978688 00000100:00100000:3.0:1787383518.366692:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984978816 00000100:00100000:3.0:1787383518.366694:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984978816 00000100:00100000:3.0:1787383518.366708:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787383518.366714:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984978688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383518.366747:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984978688:12345-0@lo:400:kworker.0 Request processed in 33us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383518.366753:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787383518.366785:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787383518.366791:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984978816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383518.366817:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206984978816:12345-0@lo:400:kworker.0 Request processed in 26us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383518.366823:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787383518.366839:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984978304 00000100:00100000:3.0:1787383518.366850:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984978304 00000100:00100000:3.0:1787383518.366879:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787383518.366885:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984978304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383518.366913:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984978304:12345-0@lo:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383518.366919:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787383518.366939:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984978304:0@lo:400:kworker.0 00000100:00100000:3.0:1787383518.366947:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206984978816:0@lo:400:kworker.0 00010000:00080000:3.0:1787383518.366955:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636084b7480 x1874206984978688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383518.366963:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984978688:0@lo:400:kworker.0 00000100:00100000:1.0:1787383518.368965:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963502069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984977536:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787383518.372839:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383518.372851:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383518.372854:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383518.378189:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984978176 00000100:00100000:0.0:1787383518.378204:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984978176 00000100:00100000:0.0:1787383518.378269:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787383518.378279:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984978176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383518.378364:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984978176:12345-0@lo:400:kworker.0 Request processed in 86us (11901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383518.378372:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787383518.378458:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984978176:0@lo:400:kworker.0 00010000:00010000:3.0:1787383518.875068:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787383519.259973:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787383519.581279:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383519.581409:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966018176 00000100:00100000:3.0:1787383519.581419:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966018176 00000100:00100000:3.0:1787383519.581503:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:3.0:1787383519.581514:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+6:15582:x1874206966018176:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383519.581532:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383519.581552:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0a00/0xc40acec91532fb85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402ba9 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787383519.581795:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787383519.581936:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fb8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.581950:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fb8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.581974:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fb8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.581988:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fb93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.581995:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fb93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582001:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fb93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582074:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532fb9a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582082:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532fb9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582088:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532fb9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383519.582125:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787383519.582129:0:17094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383519.582162:0:17094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532fb9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582173:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fb8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582179:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fb8c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582195:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fb8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582201:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383519.582206:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fb8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582214:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fb8c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582226:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9636421d3900) 00010000:00010000:3.0:1787383519.582229:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383519.582234:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fb8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582240:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fb8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582253:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fb93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582259:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fb93 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582265:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fb93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582270:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383519.582273:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fb93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582288:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fb93 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582297:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff963628ebfe00) 00010000:00010000:3.0:1787383519.582300:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383519.582303:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fb93 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582380:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fb93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582415:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0a00/0xc40acec91532fb85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402ba9 expref: 8 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582496:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532fb9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402ba9 expref: 7 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.582505:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff963628ebf800) 00010000:00010000:3.0:1787383519.582507:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383519.582510:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0800, rc 0) 00000100:00100000:3.0:1787383519.582695:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+7:15582:x1874206966018176:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 1182us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383519.582703:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:2.0:1787383519.597519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383519.597752:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966018304 00000100:00100000:3.0:1787383519.597762:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966018304 00000100:00100000:3.0:1787383519.597841:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:3.0:1787383519.597851:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eeae0f85-81db-4a53-adaf-9a6519b93273+7:15582:x1874206966018304:12345-192.168.203.2@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787383519.598055:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eeae0f85-81db-4a53-adaf-9a6519b93273+7:15582:x1874206966018304:12345-192.168.203.2@tcp:900:lhsmtool_posix.0 Request processed in 204us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383519.598063:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:1.0:1787383519.610464:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383519.610835:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966018560 00000100:00100000:3.0:1787383519.610845:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966018560 00000100:00100000:3.0:1787383519.613464:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:3.0:1787383519.613486:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+7:15582:x1874206966018560:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383519.613508:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383519.613529:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0a00/0xc40acec91532fba1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402bb0 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.613610:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fba8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.613635:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fba8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.613647:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fba8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.613700:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbaf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.613708:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.613715:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.613961:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532fbb6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614052:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532fbb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614060:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532fbb6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383519.614071:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787383519.614661:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fba8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614673:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fba8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614681:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fba8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614687:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383519.614691:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fba8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614698:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fba8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614710:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff963628ebf800) 00010000:00010000:3.0:1787383519.614713:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383519.614717:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fba8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614723:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fba8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614736:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614749:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbaf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614753:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbaf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614758:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383519.614760:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbaf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614863:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbaf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614872:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff963628ebfe00) 00010000:00010000:3.0:1787383519.614875:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383519.614878:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbaf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.614883:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbaf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.617532:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0a00/0xc40acec91532fba1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bb0 expref: 10 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.617560:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532fbb6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bb0 expref: 9 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.617570:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628ebf400) 00010000:00010000:3.0:1787383519.617573:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383519.617592:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0e00, rc 0) 00000100:00100000:3.0:1787383519.617693:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+9:15582:x1874206966018560:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 4215us (7235us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787383519.617704:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:2.0:1787383519.622887:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383519.622951:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966018688 00000100:00100000:3.0:1787383519.622961:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966018688 00000100:00100000:3.0:1787383519.623021:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:3.0:1787383519.623031:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+9:15582:x1874206966018688:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787383519.623134:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+9:15582:x1874206966018688:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 103us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383519.623142:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:0.0:1787383519.628881:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383519.628967:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966018816 00000100:00100000:3.0:1787383519.628976:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966018816 00000100:00100000:3.0:1787383519.629047:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:3.0:1787383519.629057:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+5:15582:x1874206966018816:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1787383519.629183:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787383519.631545:0:19236:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2448us 00000100:00100000:3.0:1787383519.657406:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+5:15582:x1874206966018816:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 28341us (28524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383519.657420:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:1.0:1787383519.682692:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383519.682817:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966018944 00000100:00100000:3.0:1787383519.682828:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966018944 00000100:00100000:3.0:1787383519.682892:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:3.0:1787383519.682903:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+9:15588:x1874206966018944:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383519.682924:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383519.682955:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0a00/0xc40acec91532fbc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402bb7 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683048:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbcb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683062:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683077:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683092:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fbd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683098:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683105:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683144:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683151:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbcb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683157:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683162:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383519.683166:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683181:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683194:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9636421d3900) 00010000:00010000:3.0:1787383519.683197:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383519.683202:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683209:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fbcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683222:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683227:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fbd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683233:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683238:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383519.683241:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683248:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fbd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683255:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff963628ebfe00) 00010000:00010000:3.0:1787383519.683258:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383519.683260:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fbd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683276:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fbd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683308:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0a00/0xc40acec91532fbc4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bb7 expref: 10 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683320:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9636421d3900) 00010000:00010000:3.0:1787383519.683322:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383519.683325:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0a00/0xc40acec91532fbc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bb7 expref: 10 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.683333:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0a00, rc 0) 00000100:00100000:3.0:1787383519.683449:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+9:15588:x1874206966018944:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 547us (766us total) trans 0 rc 301/301 00000100:00100000:3.0:1787383519.683456:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:1.0:1787383519.693418:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383519.694995:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966019072 00000100:00100000:2.0:1787383519.695020:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966019072 00000100:00100000:2.0:1787383519.695071:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:2.0:1787383519.695081:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:eeae0f85-81db-4a53-adaf-9a6519b93273+9:15588:x1874206966019072:12345-192.168.203.2@tcp:700:lfs.0 00000100:00100000:2.0:1787383519.695172:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:eeae0f85-81db-4a53-adaf-9a6519b93273+9:15588:x1874206966019072:12345-192.168.203.2@tcp:700:lfs.0 Request processed in 92us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383519.695180:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:2.0:1787383519.698359:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383519.698501:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966019328 00000100:00100000:0.0:1787383519.698510:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966019328 00000100:00100000:0.0:1787383519.698577:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:0.0:1787383519.698588:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+9:15588:x1874206966019328:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:0.0:1787383519.698842:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383519.698878:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532faf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b24 expref: 9 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.698897:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9636421d3900) 00010000:00010000:0.0:1787383519.698902:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383519.698976:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.698989:0:17095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fb31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b94 expref: 5 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.698997:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.699031:0:17095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fb31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b94 expref: 5 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.699045:0:17095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fb31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b94 expref: 5 pid: 17095 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383519.699061:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984979072:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383519.699132:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383519.703139:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984979072:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383519.703168:0:17095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383519.703571:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383519.703709:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966019456 00000100:00100000:3.0:1787383519.703716:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966019456 00010000:00010000:3.0:1787383519.703760:0:17079:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fb31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b94 expref: 6 pid: 17095 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383519.703827:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:3.0:1787383519.703836:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2401:x1874206966019456:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383519.703851:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383519.703858:0:17079:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fb31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b94 expref: 6 pid: 17095 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.703888:0:17079:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fb31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b94 expref: 6 pid: 17095 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.703910:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fb31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b94 expref: 6 pid: 17095 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.703926:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9636421d3900) 00010000:00010000:3.0:1787383519.703930:0:17079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.703949:0:17079:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.703956:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.703978:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383519.704023:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2401:x1874206966019456:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 187us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383519.704031:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00010000:00010000:0.0:1787383519.704625:0:17095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.704646:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.704672:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8000/0xc40acec91532fbe0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.704681:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8000/0xc40acec91532fbe0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.704690:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8000/0xc40acec91532fbe0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787383519.705590:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787383519.708232:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8e00/0xc40acec91532fbe7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.708252:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8e00/0xc40acec91532fbe7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.708263:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8e00/0xc40acec91532fbe7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383519.708281:0:17095:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049a62903 reply state 000000004d57df41 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8e00/0xc40acec91532fbe7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.708292:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8e00/0xc40acec91532fbe7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.708298:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96350244ba00) 00010000:00010000:0.0:1787383519.708301:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383519.708305:0:17095:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787383519.708380:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787383519.708398:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.708406:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.708412:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.708418:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac9a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383519.708422:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.708429:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.708440:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9636421d3900) 00010000:00010000:0.0:1787383519.708443:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383519.708447:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.708452:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9a00/0xc40acec91532fbd9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383519.708470:0:17095:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049a62903 reply state 000000004d57df41 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8000/0xc40acec91532fbe0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.708479:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8000/0xc40acec91532fbe0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.708485:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96350244b300) 00010000:00010000:0.0:1787383519.708488:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383519.708495:0:17095:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787383519.708790:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+10:15588:x1874206966019328:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 10176us (10412us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787383519.708800:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:2.0:1787383519.792686:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383519.792944:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966019584 00000100:00100000:3.0:1787383519.792959:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966019584 00000100:00100000:3.0:1787383519.793042:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:3.0:1787383519.793055:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+10:15596:x1874206966019584:12345-192.168.203.2@tcp:101:lctl.0 00010000:00010000:3.0:1787383519.793089:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383519.793119:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fbee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402bbe expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.793233:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0a00/0xc40acec91532fbf5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.793249:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0a00/0xc40acec91532fbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.793262:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0a00/0xc40acec91532fbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383519.793319:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787383519.793323:0:17096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383519.793365:0:17096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0a00/0xc40acec91532fbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.793396:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fbee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bbe expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.793419:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0a00/0xc40acec91532fbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bbe expref: 11 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.793429:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebfe00) 00010000:00010000:3.0:1787383519.793433:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383519.793437:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0a00, rc 0) 00000100:00100000:3.0:1787383519.793519:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+11:15596:x1874206966019584:12345-192.168.203.2@tcp:101:lctl.0 Request processed in 466us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383519.793526:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:1.0:1787383519.795637:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383519.795797:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966019712 00000100:00100000:0.0:1787383519.795813:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966019712 00000100:00100000:0.0:1787383519.795884:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 163 00000100:00100000:0.0:1787383519.795892:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+13:2402:x1874206966019712:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383519.795985:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+13:2402:x1874206966019712:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 93us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383519.795991:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 163 00000100:00100000:1.0:1787383519.798244:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383519.798304:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383519.798501:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966019840 00000100:00100000:0.0:1787383519.798514:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966019840 00000100:00100000:0.0:1787383519.798604:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966019968 00000100:00100000:0.0:1787383519.798607:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966019968 00000100:00100000:0.0:1787383519.798651:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:0.0:1787383519.798664:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966019840:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383519.798759:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966019840:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 98us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383519.798803:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:0.0:1787383519.798822:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:0.0:1787383519.798829:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966019968:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383519.798854:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966019968:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 26us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383519.798860:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00080000:1.0:1787383519.799545:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383519.799559:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383519.800322:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383519.800362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383519.800412:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383519.800537:0:19676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966020352 00000100:00100000:2.0:1787383519.800548:0:19676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966020352 00000100:00100000:2.0:1787383519.800636:0:19676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966020224 00000100:00100000:2.0:1787383519.800639:0:19676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966020224 00000100:00100000:2.0:1787383519.800663:0:19676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383519.800672:0:19676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2401:x1874206966020352:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383519.800761:0:19676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2401:x1874206966020352:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 90us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383519.800793:0:19676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383519.800808:0:19676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:2.0:1787383519.800815:0:19676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2401:x1874206966020224:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383519.800839:0:19676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2401:x1874206966020224:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383519.800846:0:19676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:0.0:1787383519.801432:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966020096 00000100:00100000:0.0:1787383519.801451:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966020096 00000100:00100000:0.0:1787383519.801501:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:0.0:1787383519.801508:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2401:x1874206966020096:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383519.801572:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2401:x1874206966020096:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 63us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383519.801578:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00080000:3.0:1787383519.801937:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787383519.801942:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383519.801945:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787383519.823273:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383519.823406:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966020480 00000100:00100000:2.0:1787383519.823420:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966020480 00000100:00100000:2.0:1787383519.823507:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:2.0:1787383519.823536:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:15597:x1874206966020480:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1787383519.823579:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383519.823612:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7c00/0xc40acec91532fbfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402bc5 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383519.823717:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532fc03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383519.823734:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532fc03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383519.823747:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532fc03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383519.823838:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787383519.823842:0:17096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383519.823868:0:17096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532fc03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383519.823896:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7c00/0xc40acec91532fbfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bc5 expref: 7 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383519.823917:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532fc03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bc5 expref: 6 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383519.823925:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebfe00) 00010000:00010000:2.0:1787383519.823929:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383519.823932:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7a00, rc 0) 00000100:00100000:2.0:1787383519.824081:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:15597:x1874206966020480:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 548us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383519.824099:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:2.0:1787383519.828507:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383519.828645:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966020608 00000100:00100000:0.0:1787383519.828658:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966020608 00000100:00100000:0.0:1787383519.829279:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:0.0:1787383519.829293:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:15597:x1874206966020608:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383519.829320:0:19236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383519.829349:0:19236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402bcc expref: -99 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829437:0:19236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829454:0:19236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829467:0:19236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829480:0:19236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829487:0:19236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829493:0:19236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829607:0:19236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8600/0xc40acec91532fc1f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829627:0:19236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8600/0xc40acec91532fc1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829635:0:19236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8600/0xc40acec91532fc1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383519.829684:0:19236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787383519.829689:0:19236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383519.829727:0:19236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8600/0xc40acec91532fc1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829742:0:19236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829749:0:19236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc11 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829756:0:19236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829792:0:19236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac9c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383519.829798:0:19236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829807:0:19236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829821:0:19236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebfe00) 00010000:00010000:0.0:1787383519.829831:0:19236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383519.829838:0:19236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829845:0:19236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829863:0:19236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829875:0:19236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829881:0:19236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829887:0:19236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac9e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383519.829889:0:19236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829896:0:19236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829905:0:19236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96350244b300) 00010000:00010000:0.0:1787383519.829907:0:19236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383519.829910:0:19236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829916:0:19236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829949:0:19236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bcc expref: 8 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829984:0:19236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8600/0xc40acec91532fc1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bcc expref: 7 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.829992:0:19236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96350244ba00) 00010000:00010000:0.0:1787383519.829995:0:19236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383519.829997:0:19236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac8600, rc 0) 00000100:00100000:0.0:1787383519.830081:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+7:15597:x1874206966020608:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 792us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383519.830090:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:1.0:1787383519.832609:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383519.832893:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966020736 00000100:00100000:3.0:1787383519.833021:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966020736 00000100:00100000:2.0:1787383519.834088:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:2.0:1787383519.834104:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:15597:x1874206966020736:12345-192.168.203.2@tcp:900:lfs.0 00000100:00100000:2.0:1787383519.834224:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:15597:x1874206966020736:12345-192.168.203.2@tcp:900:lfs.0 Request processed in 123us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383519.835048:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:2.0:1787383519.839411:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383519.840745:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966020992 00000100:00100000:3.0:1787383519.840762:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966020992 00000100:00100000:2.0:1787383519.841089:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:2.0:1787383519.841102:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+7:15597:x1874206966020992:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:2.0:1787383519.841129:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383519.841158:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec91532fc26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402bd3 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383519.841293:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787383519.841429:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec91532fc26 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bd3 expref: 9 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383519.841447:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebfe00) 00010000:00010000:2.0:1787383519.841451:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383519.841458:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec91532fc26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bd3 expref: 9 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383519.841475:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8800, rc 0) 00000100:00100000:2.0:1787383519.841566:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+8:15597:x1874206966020992:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 466us (2167us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787383519.841593:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:3.0:1787383519.847421:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383519.847638:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966021248 00000100:00100000:1.0:1787383519.847652:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966021248 00000100:00100000:1.0:1787383519.847730:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:1.0:1787383519.847743:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+8:15597:x1874206966021248:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:1.0:1787383519.847876:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383519.847912:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8600/0xc40acec91532fc1f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bcc expref: 8 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383519.847937:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96350244ba00) 00010000:00010000:1.0:1787383519.847943:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383519.847972:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6e00/0xc40acec91532fc34 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383519.847988:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6e00/0xc40acec91532fc34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383519.848000:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6e00/0xc40acec91532fc34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383519.848241:0:17095:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b12202a8 reply state 00000000deaa3ebe transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6e00/0xc40acec91532fc34 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383519.848256:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6e00/0xc40acec91532fc34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383519.848262:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96350244ba00) 00010000:00010000:1.0:1787383519.848265:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1787383519.848268:0:17095:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787383519.848279:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787383519.849365:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+9:15597:x1874206966021248:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 1616us (1951us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787383519.849379:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:1.0:1787383519.854906:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383519.855054:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966021504 00000100:00100000:0.0:1787383519.855072:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966021504 00000100:00100000:0.0:1787383519.855152:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:0.0:1787383519.855164:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+9:15597:x1874206966021504:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383519.855514:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+10:15597:x1874206966021504:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 351us (621us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787383519.855524:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:2.0:1787383519.858599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383519.858828:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966021760 00000100:00100000:0.0:1787383519.858841:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966021760 00000100:00100000:0.0:1787383519.858907:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:0.0:1787383519.858919:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+10:15597:x1874206966021760:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383519.858951:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383519.858977:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402bda expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859066:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859098:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859112:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859124:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859131:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859138:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383519.859267:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787383519.859365:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859373:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859391:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859398:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac9e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383519.859403:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859413:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859437:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebfe00) 00010000:00010000:0.0:1787383519.859440:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383519.859446:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859453:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859470:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859477:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859483:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859488:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac9c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383519.859490:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859496:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859502:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96350244b300) 00010000:00010000:0.0:1787383519.859504:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383519.859506:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859512:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859555:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bda expref: 12 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859565:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebfe00) 00010000:00010000:0.0:1787383519.859567:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383519.859571:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bda expref: 12 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.859722:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9000, rc 0) 00000100:00100000:0.0:1787383519.859850:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+11:15597:x1874206966021760:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 933us (1276us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787383519.859860:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:3.0:1787383519.863207:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383519.863540:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966021888 00000100:00100000:0.0:1787383519.863553:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966021888 00000100:00100000:0.0:1787383519.863714:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:0.0:1787383519.863728:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+11:15597:x1874206966021888:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383519.863760:0:19236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383519.863892:0:19236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc57 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402be1 expref: -99 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.864019:0:19236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532fc5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.864038:0:19236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532fc5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.864052:0:19236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532fc5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383519.864104:0:19236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787383519.864109:0:19236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383519.864137:0:19236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532fc5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.864174:0:19236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc57 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402be1 expref: 13 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.864197:0:19236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532fc5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402be1 expref: 12 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.864208:0:19236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96350244ba00) 00010000:00010000:0.0:1787383519.864212:0:19236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383519.864216:0:19236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac8a00, rc 0) 00000100:00100000:0.0:1787383519.864365:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+12:15597:x1874206966021888:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 641us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383519.864375:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:1.0:1787383519.885096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383519.885214:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966022016 00000100:00100000:0.0:1787383519.885227:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966022016 00000100:00100000:0.0:1787383519.885301:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:0.0:1787383519.885313:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+12:15597:x1874206966022016:12345-192.168.203.2@tcp:37:lfs.0 00000100:00100000:1.0:1787383519.890699:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+12:15597:x1874206966022016:12345-192.168.203.2@tcp:37:lfs.0 Request processed in 5370us (5599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383519.890719:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:3.0:1787383519.896070:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383519.896431:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966022272 00000100:00100000:2.0:1787383519.896447:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966022272 00000100:00100000:2.0:1787383519.896533:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:2.0:1787383519.896545:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502637850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+12:15597:x1874206966022272:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1787383519.896926:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502637850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+13:15597:x1874206966022272:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 381us (869us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787383519.896938:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:1.0:1787383519.899047:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984979200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383519.899133:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383519.899254:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984979200 00000100:00100000:0.0:1787383519.899264:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984979200 00000100:00100000:0.0:1787383519.899332:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787383519.899344:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984979200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787383519.899369:0:18604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787383519.899457:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984979200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383519.899797:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787383519.899862:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984979200:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787383519.900112:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383519.956823:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383519.956931:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966022400 00000100:00100000:0.0:1787383519.956944:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966022400 00000100:00100000:0.0:1787383519.957058:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:0.0:1787383519.957069:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+11:15603:x1874206966022400:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:0.0:1787383519.957096:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383519.957123:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402be8 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957212:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957229:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957244:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957257:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957264:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957271:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957402:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957412:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957419:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383519.957462:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787383519.957686:0:17094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383519.957737:0:17094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957752:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957760:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957818:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957825:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac9000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383519.957830:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957839:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957854:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebfe00) 00010000:00010000:0.0:1787383519.957864:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383519.957870:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957876:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fc6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957893:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957898:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957903:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957908:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac9c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383519.957912:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957917:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957925:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96350244b300) 00010000:00010000:0.0:1787383519.957927:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383519.957930:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957934:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957964:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402be8 expref: 13 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957991:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402be8 expref: 12 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.957999:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96350244ba00) 00010000:00010000:0.0:1787383519.958002:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787383519.958004:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9e00, rc 0) 00000100:00100000:0.0:1787383519.958093:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+12:15603:x1874206966022400:12345-192.168.203.2@tcp:101:bash.0 Request processed in 1025us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383519.958101:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:3.0:1787383519.963074:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383519.963582:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966022528 00000100:00100000:2.0:1787383519.963596:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966022528 00000100:00100000:2.0:1787383519.963839:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:2.0:1787383519.963852:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eeae0f85-81db-4a53-adaf-9a6519b93273+5:15603:x1874206966022528:12345-192.168.203.2@tcp:900:bash.0 00000100:00100000:2.0:1787383519.963962:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eeae0f85-81db-4a53-adaf-9a6519b93273+5:15603:x1874206966022528:12345-192.168.203.2@tcp:900:bash.0 Request processed in 112us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383519.963970:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:2.0:1787383519.970969:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383519.975025:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966022784 00000100:00100000:1.0:1787383519.975047:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966022784 00000100:00100000:1.0:1787383519.975195:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:1.0:1787383519.975208:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+12:15603:x1874206966022784:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1787383519.975238:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383519.975267:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6600/0xc40acec91532fc81 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402bef expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383519.975422:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383519.975439:0:17095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532fc5e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402be1 expref: 12 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383519.975450:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383519.975508:0:17095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532fc5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402be1 expref: 12 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383519.975525:0:17095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532fc5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402be1 expref: 12 pid: 19236 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383519.975577:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984979328:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383519.975700:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff963601254180 going to sleep for 11 seconds 00000100:00100000:0.0:1787383519.979252:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984979328:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383519.979297:0:17095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383519.980904:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383519.981429:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966022912 00000100:00100000:3.0:1787383519.981444:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966022912 00010000:00010000:3.0:1787383519.984028:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532fc5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402be1 expref: 13 pid: 19236 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383519.984834:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:3.0:1787383519.984857:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+13:2401:x1874206966022912:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383519.984880:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383519.984889:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532fc5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402be1 expref: 13 pid: 19236 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.984906:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532fc5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402be1 expref: 13 pid: 19236 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.984939:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8a00/0xc40acec91532fc5e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402be1 expref: 13 pid: 19236 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.984989:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96350244ba00) 00010000:00010000:3.0:1787383519.984996:0:17080:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.985008:0:17080:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.985017:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383519.985065:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383519.985153:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+12:2401:x1874206966022912:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 308us (4261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383519.985162:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00010000:00010000:0.0:1787383519.985238:0:17095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.985247:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.985277:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc8f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.985289:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.985297:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.985969:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc96 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.985984:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.985992:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383519.986004:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787383519.986036:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.986043:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.986051:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.986057:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383519.986061:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.986069:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.986080:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96350244ba00) 00010000:00010000:0.0:1787383519.986083:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383519.986086:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.986106:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6000/0xc40acec91532fc88 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383519.986121:0:17095:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de4dd845 reply state 000000008c9319ed transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.986133:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.986140:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff96350244b800) 00010000:00010000:0.0:1787383519.986142:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383519.986145:0:17095:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787383519.986190:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6600/0xc40acec91532fc81 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bef expref: 15 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.986205:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bef expref: 14 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383519.986214:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:0.0:1787383519.986215:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787383519.986218:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9c00, rc 0) 00000100:00100000:0.0:1787383519.986268:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+15:15603:x1874206966022784:12345-192.168.203.2@tcp:101:bash.0 Request processed in 11063us (15312us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787383519.986276:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:1.0:1787383520.004989:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383520.005117:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966023040 00000100:00100000:2.0:1787383520.005130:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966023040 00000100:00100000:2.0:1787383520.005211:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:2.0:1787383520.005223:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+15:15603:x1874206966023040:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1787383520.005256:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383520.005305:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fca4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402bf6 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.005400:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fcab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.005416:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fcab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.005429:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fcab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383520.005668:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787383520.005673:0:17096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383520.005709:0:17096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fcab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.005722:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fcab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.005755:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fca4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bf6 expref: 17 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.005829:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fcab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bf6 expref: 16 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.005840:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:2.0:1787383520.005843:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383520.005847:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9200, rc 0) 00000100:00100000:2.0:1787383520.005930:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+16:15603:x1874206966023040:12345-192.168.203.2@tcp:101:bash.0 Request processed in 708us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383520.005950:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:1.0:1787383520.011004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383520.011226:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966023296 00000100:00100000:2.0:1787383520.011239:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966023296 00000100:00100000:2.0:1787383520.011351:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:2.0:1787383520.011364:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+16:15603:x1874206966023296:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:2.0:1787383520.011863:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+17:15603:x1874206966023296:12345-192.168.203.2@tcp:35:bash.0 Request processed in 500us (872us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787383520.011872:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:3.0:1787383520.124423:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383520.124624:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966023552 00000100:00100000:0.0:1787383520.124637:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966023552 00000100:00100000:0.0:1787383520.124726:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:0.0:1787383520.124738:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+17:15613:x1874206966023552:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383520.124833:0:19236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383520.124863:0:19236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fcb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402bfd expref: -99 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383520.124999:0:19236:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787383520.125129:0:19236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fcb2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bfd expref: 19 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.125147:0:19236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebfe00) 00010000:00010000:0.0:1787383520.125150:0:19236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383520.125155:0:19236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fcb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bfd expref: 19 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.125172:0:19236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9000, rc 0) 00000100:00100000:0.0:1787383520.125258:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+18:15613:x1874206966023552:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 522us (850us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787383520.125266:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:3.0:1787383520.134591:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383520.134753:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966023808 00000100:00100000:1.0:1787383520.134823:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966023808 00000100:00100000:1.0:1787383520.134891:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:1.0:1787383520.134903:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+18:15613:x1874206966023808:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:1.0:1787383520.135223:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+19:15613:x1874206966023808:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 320us (645us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787383520.135232:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:3.0:1787383520.205910:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383520.206049:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966024064 00000100:00100000:0.0:1787383520.206062:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966024064 00000100:00100000:0.0:1787383520.206143:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:0.0:1787383520.206155:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+19:15616:x1874206966024064:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383520.206186:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383520.206211:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fcc0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c04 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.206358:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532fcc7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.206407:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532fcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.206420:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532fcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383520.206434:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787383520.206566:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fcc0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c04 expref: 22 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.206591:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532fcc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c04 expref: 21 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.206600:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:0.0:1787383520.206603:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383520.206608:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9400, rc 0) 00000100:00100000:0.0:1787383520.206702:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+21:15616:x1874206966024064:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 548us (805us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787383520.206711:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:3.0:1787383520.209899:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383520.209950:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383520.210068:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966024320 00000100:00100000:2.0:1787383520.210081:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966024320 00000100:00100000:2.0:1787383520.210163:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:2.0:1787383520.210175:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+21:2403:x1874206966024320:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383520.210220:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383520.210254:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9400/0xc40acec91532fcc7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c04 expref: 21 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.210279:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:2.0:1787383520.210285:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383520.210357:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+20:2403:x1874206966024320:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 184us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383520.210366:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:0.0:1787383520.213133:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966024192 00000100:00100000:0.0:1787383520.213153:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966024192 00000100:00100000:0.0:1787383520.213247:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:0.0:1787383520.213260:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+20:15616:x1874206966024192:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:0.0:1787383520.213349:0:19236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fcd5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.213369:0:19236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fcd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.213404:0:19236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fcd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.213450:0:19236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fcd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.213458:0:19236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fcd5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.213464:0:19236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fcd5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.213470:0:19236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383520.213474:0:19236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fcd5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.213480:0:19236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fcd5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.213492:0:19236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:0.0:1787383520.213495:0:19236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383520.213499:0:19236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fcd5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.213505:0:19236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fcd5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383520.213599:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+20:15616:x1874206966024192:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 342us (3712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383520.213608:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:3.0:1787383520.218819:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383520.218943:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966024576 00000100:00100000:2.0:1787383520.218958:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966024576 00000100:00100000:2.0:1787383520.219022:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:2.0:1787383520.219034:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+20:15616:x1874206966024576:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1787383520.219363:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+21:15616:x1874206966024576:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 329us (600us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787383520.219371:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000040:00080000:3.0:1787383520.284223:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787383520.537266:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383520.539248:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966024832 00000100:00100000:0.0:1787383520.539268:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966024832 00000100:00100000:0.0:1787383520.539391:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:0.0:1787383520.539403:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+21:15647:x1874206966024832:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:0.0:1787383520.539437:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383520.539477:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fcdc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c0b expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.539997:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fce3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.540017:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fce3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.540031:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fce3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383520.540047:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787383520.540829:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fcdc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c0b expref: 24 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.540861:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fce3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c0b expref: 23 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.541020:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:0.0:1787383520.541024:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383520.541027:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9000, rc 0) 00000100:00100000:0.0:1787383520.541345:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+23:15647:x1874206966024832:12345-192.168.203.2@tcp:101:cat.0 Request processed in 1942us (4092us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787383520.541380:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:3.0:1787383520.546482:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383520.548975:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966025088 00000100:00100000:2.0:1787383520.548992:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966025088 00000100:00100000:2.0:1787383520.549077:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:2.0:1787383520.549087:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+23:15647:x1874206966025088:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:2.0:1787383520.549475:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+24:15647:x1874206966025088:12345-192.168.203.2@tcp:35:cat.0 Request processed in 386us (3006us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787383520.549486:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:3.0:1787383520.550272:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383520.552139:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966025216 00000100:00100000:1.0:1787383520.552160:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966025216 00000100:00100000:1.0:1787383520.552264:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:1.0:1787383520.552276:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+24:2401:x1874206966025216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383520.552295:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383520.552327:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9000/0xc40acec91532fce3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c0b expref: 24 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383520.552354:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:1.0:1787383520.552360:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383520.552446:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+23:2401:x1874206966025216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 171us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383520.552455:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:3.0:1787383520.627854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383520.627979:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966025472 00000100:00100000:1.0:1787383520.627992:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966025472 00000100:00100000:1.0:1787383520.628068:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:1.0:1787383520.628089:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+23:15653:x1874206966025472:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:1.0:1787383520.628121:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383520.628149:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fcf1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c12 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383520.628295:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7000/0xc40acec91532fcf8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383520.628313:0:17095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc96 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bef expref: 24 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383520.628323:0:17095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fcab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bf6 expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383520.628332:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7000/0xc40acec91532fcf8 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383520.628376:0:17095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fcab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bf6 expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383520.628390:0:17095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fcab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bf6 expref: 24 pid: 17096 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383520.628405:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984979456:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383520.628984:0:17095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bef expref: 24 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383520.629019:0:17095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bef expref: 24 pid: 17095 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383520.629031:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984979584:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383520.629083:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff963601254540 going to sleep for 11 seconds 00000100:00100000:3.0:1787383520.631284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383520.632318:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966025600 00000100:00100000:2.0:1787383520.632335:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966025600 00010000:00010000:2.0:1787383520.632397:0:17079:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fcab lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bf6 expref: 25 pid: 17096 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383520.632455:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:2.0:1787383520.632467:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+25:2401:x1874206966025600:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383520.632485:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383520.632493:0:17079:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fcab lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bf6 expref: 25 pid: 17096 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.632508:0:17079:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fcab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bf6 expref: 25 pid: 17096 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.632535:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:2.0:1787383520.632542:0:17079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7000/0xc40acec91532fcf8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.632580:0:17079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7000/0xc40acec91532fcf8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.632587:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383520.632680:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+25:2401:x1874206966025600:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 214us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383520.632689:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00010000:00010000:1.0:1787383520.632924:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fcab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bf6 expref: 25 pid: 17096 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383520.632948:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984979456:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383520.634949:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383520.635057:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984979584:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383520.635097:0:17095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7000/0xc40acec91532fcf8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383520.635320:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966025728 00000100:00100000:2.0:1787383520.635330:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966025728 00010000:00010000:2.0:1787383520.635378:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bef expref: 24 pid: 17095 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383520.635422:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:2.0:1787383520.635433:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363db4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+24:2402:x1874206966025728:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383520.635453:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383520.635461:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bef expref: 24 pid: 17095 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.635473:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bef expref: 24 pid: 17095 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.635500:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9c00/0xc40acec91532fc96 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bef expref: 24 pid: 17095 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.635520:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:2.0:1787383520.635526:0:17081:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7000/0xc40acec91532fcf8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.635564:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7000/0xc40acec91532fcf8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.635573:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7000/0xc40acec91532fcf8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.635651:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383520.635993:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363db4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+23:2402:x1874206966025728:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 559us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383520.636002:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00010000:00010000:0.0:1787383520.641676:0:17095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7000/0xc40acec91532fcf8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.641699:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7000/0xc40acec91532fcf8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383520.641729:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787383520.642092:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fcf1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c12 expref: 24 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.642119:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7000/0xc40acec91532fcf8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c12 expref: 23 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.642130:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:0.0:1787383520.642134:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787383520.642138:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636082a7000, rc 0) 00000100:00100000:0.0:1787383520.642534:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+23:15653:x1874206966025472:12345-192.168.203.2@tcp:101:dd.0 Request processed in 14453us (14692us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787383520.642546:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:3.0:1787383520.645877:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383520.645957:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966025856 00000100:00100000:2.0:1787383520.645970:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966025856 00000100:00100000:2.0:1787383520.646044:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:2.0:1787383520.646056:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+23:15653:x1874206966025856:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:2.0:1787383520.646088:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383520.646115:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fd06 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c19 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.646162:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fd0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.646178:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fd0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.646192:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fd0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.646357:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fd06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c19 expref: 25 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.646390:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fd0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c19 expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.646399:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:2.0:1787383520.646403:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383520.646407:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9200, rc 0) 00000100:00100000:2.0:1787383520.646951:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+24:15653:x1874206966025856:12345-192.168.203.2@tcp:101:dd.0 Request processed in 894us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383520.646961:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:3.0:1787383520.650020:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383520.650492:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966026112 00000100:00100000:0.0:1787383520.650506:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966026112 00000100:00100000:0.0:1787383520.650587:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:0.0:1787383520.650598:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+24:15653:x1874206966026112:12345-192.168.203.2@tcp:36:dd.0 00010000:00010000:0.0:1787383520.651382:0:19236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532fd14 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.651406:0:19236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532fd14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.651420:0:19236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532fd14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787383520.651484:0:19236:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787383520.651509:0:19236:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d7008944 reply state 00000000b3148dd0 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532fd14 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.651524:0:19236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532fd14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383520.651537:0:19236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:0.0:1787383520.651540:0:19236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383520.651546:0:19236:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383520.652485:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+27:15653:x1874206966026112:12345-192.168.203.2@tcp:36:dd.0 Request processed in 1877us (2467us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787383520.652497:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00000020:00080000:0.0:1787383520.652506:0:19236:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787383520.655078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383520.656719:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966026240 00000100:00100000:0.0:1787383520.656738:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966026240 00000100:00100000:1.0:1787383520.657050:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:1.0:1787383520.657063:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+27:15653:x1874206966026240:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:1.0:1787383520.657098:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383520.657125:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd1b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c20 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383520.657217:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd1b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c20 expref: 28 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383520.657235:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd1b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c20 expref: 28 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383520.657259:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:1.0:1787383520.657279:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787383520.657284:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636082a7800, rc 0) 00000100:00100000:1.0:1787383520.657584:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+28:15653:x1874206966026240:12345-192.168.203.2@tcp:101:dd.0 Request processed in 521us (2519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383520.657593:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 46 00000040:00080000:0.0:1787383520.668529:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787383520.672670:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383520.672827:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966026496 00000100:00100000:3.0:1787383520.672840:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966026496 00000100:00100000:3.0:1787383520.672928:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:3.0:1787383520.672939:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+28:15653:x1874206966026496:12345-192.168.203.2@tcp:103:dd.0 00010000:00010000:3.0:1787383520.672960:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383520.672993:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd1b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c20 expref: 28 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383520.673018:0:17080:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:3.0:1787383520.673024:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383520.673094:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+27:15653:x1874206966026496:12345-192.168.203.2@tcp:103:dd.0 Request processed in 156us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383520.673102:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:0.0:1787383520.676859:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383520.677078:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966026624 00000100:00100000:1.0:1787383520.677092:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966026624 00000100:00100000:1.0:1787383520.677174:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:1.0:1787383520.677187:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+27:15653:x1874206966026624:12345-192.168.203.2@tcp:58:dd.0 00010000:00010000:1.0:1787383520.677363:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec91532fd22 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383520.677386:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec91532fd22 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383520.677400:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec91532fd22 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383520.687493:0:17095:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383520.688453:0:17095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787383520.688648:0:17095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787383520.689153:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+27:15653:x1874206966026624:12345-192.168.203.2@tcp:58:dd.0 Request processed in 11962us (12302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383520.689166:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:1.0:1787383520.692381:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383520.699314:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966026752 00000100:00100000:2.0:1787383520.699330:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966026752 00000100:00100000:2.0:1787383520.699501:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:2.0:1787383520.699522:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+27:15653:x1874206966026752:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:2.0:1787383520.699972:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383520.699993:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fd29 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c27 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.700042:0:17096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec91532fd22 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.700053:0:17096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fd29 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c27 expref: 28 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.700072:0:17096:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec91532fd22 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.700085:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fd29 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c27 expref: 28 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.700110:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:2.0:1787383520.700114:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383520.700118:0:17096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fd29 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c27 expref: 28 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383520.700126:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8400, rc 0) 00000100:00100000:2.0:1787383520.700179:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+28:15653:x1874206966026752:12345-192.168.203.2@tcp:101:dd.0 Request processed in 670us (7885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383520.700197:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:3.0:1787383520.923097:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984979712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383520.923162:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383520.923322:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984979712 00000100:00100000:1.0:1787383520.923329:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984979712 00000100:00100000:1.0:1787383520.923370:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787383520.923376:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984979712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383520.923423:0:17099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787383520.923579:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984979712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383520.923633:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984979712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 255us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383520.923641:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1787383520.923956:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383520.924217:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383520.924550:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984979840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383520.924588:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383520.924689:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984979840 00000100:00100000:2.0:1787383520.926427:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984979840 00000100:00100000:2.0:1787383520.926577:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787383520.926587:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984979840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787383520.926630:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787383520.926793:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984979840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 207us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383520.926801:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787383520.927082:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984979840:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787383521.307041:0:17128:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787383521.307051:0:17128:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383521.307079:0:17128:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787383521.307090:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787383521.307219:0:17128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033b9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17128:1874206984979968:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787383521.307313:0:17128:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636011ca600 going to sleep for 11 seconds 00000100:00100000:1.0:1787383521.315235:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383521.315333:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966026880 00000100:00100000:0.0:1787383521.315343:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966026880 00000100:00100000:0.0:1787383521.315432:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:0.0:1787383521.315456:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+29:15654:x1874206966026880:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787383521.315486:0:19236:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1787383521.315807:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383521.316015:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+29:15654:x1874206966026880:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 561us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383521.316024:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:3.0:1787383521.316422:0:17128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033b9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17128:1874206984979968:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787383521.320413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383521.320516:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966027008 00000100:00100000:1.0:1787383521.320526:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966027008 00000100:00100000:1.0:1787383521.320597:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:1.0:1787383521.320616:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+28:15654:x1874206966027008:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787383521.320687:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fd30 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.320709:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fd30 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.320723:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fd30 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.320819:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd37 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.320827:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.320833:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.320854:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fd3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.320879:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fd3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.320886:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fd3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383521.321184:0:17094:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787383521.321188:0:17094:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787383521.321203:0:17094:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fd3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321215:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fd30 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321222:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fd30 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321228:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fd30 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321234:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383521.321237:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fd30 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321245:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fd30 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321257:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628ebf400) 00010000:00010000:1.0:1787383521.321260:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383521.321265:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fd30 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321282:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fd30 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321297:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321304:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd37 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321310:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd37 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321314:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383521.321317:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd37 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321323:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd37 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321330:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9635036bcf00) 00010000:00010000:1.0:1787383521.321333:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383521.321336:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd37 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321342:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fd37 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321363:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fd3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321369:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fd3e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321381:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fd3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321385:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383521.321388:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fd3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321394:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fd3e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321402:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:1.0:1787383521.321404:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383521.321407:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fd3e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.321413:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fd3e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383521.321487:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+28:15654:x1874206966027008:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 Request processed in 880us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383521.321497:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:2.0:1787383521.324745:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383521.324869:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966027264 00000100:00100000:1.0:1787383521.324882:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966027264 00000100:00100000:1.0:1787383521.325001:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:1.0:1787383521.325011:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+28:15654:x1874206966027264:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383521.325031:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383521.325050:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fd45 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c2e expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.325172:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.325186:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.325197:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383521.325209:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787383521.325291:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.325299:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd4c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.325306:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.325311:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383521.325315:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.325322:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd4c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.325334:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:1.0:1787383521.325337:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787383521.325341:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd4c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.325614:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd4c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.325660:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fd45 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c2e expref: 30 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.325670:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628ebf400) 00010000:00010000:1.0:1787383521.325672:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383521.325675:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fd45 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c2e expref: 30 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.325684:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636082a7e00, rc 0) 00000100:00100000:1.0:1787383521.326313:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+29:15654:x1874206966027264:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 1300us (1573us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787383521.326322:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:3.0:1787383521.337133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383521.338262:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966027392 00000100:00100000:2.0:1787383521.338274:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966027392 00000100:00100000:2.0:1787383521.340980:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:2.0:1787383521.340998:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+29:15654:x1874206966027392:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787383521.341032:0:17096:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787383521.341516:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+29:15654:x1874206966027392:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 523us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383521.341541:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:0.0:1787383521.358353:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383521.358684:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966027648 00000100:00100000:3.0:1787383521.358696:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966027648 00000100:00100000:3.0:1787383521.358756:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:3.0:1787383521.358806:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+29:15654:x1874206966027648:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383521.358827:0:19236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383521.358847:0:19236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd5a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c35 expref: -99 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787383521.359256:0:19236:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:3.0:1787383521.359263:0:19236:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:3.0:1787383521.359276:0:19236:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1787383521.359435:0:19236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fd61 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.359449:0:19236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fd61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.359459:0:19236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fd61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.359510:0:19236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd5a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c35 expref: 32 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.359528:0:19236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fd61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c35 expref: 31 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.359538:0:19236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebf500) 00010000:00010000:3.0:1787383521.359557:0:19236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383521.359561:0:19236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1c00, rc 0) 00000100:00100000:3.0:1787383521.359630:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+31:15654:x1874206966027648:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 864us (1284us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1787383521.359637:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:3.0:1787383521.365729:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383521.365867:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966027904 00000100:00100000:1.0:1787383521.365876:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966027904 00000100:00100000:1.0:1787383521.365946:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:1.0:1787383521.365956:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+31:15654:x1874206966027904:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787383521.366032:0:17094:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383521.366060:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1c00/0xc40acec91532fd61 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c35 expref: 31 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366082:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebf500) 00010000:00010000:1.0:1787383521.366092:0:17094:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383521.366116:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fd6f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366142:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fd6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366151:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fd6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366165:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd76 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x820322f0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366172:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x820322f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366178:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x820322f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366225:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fd6f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366232:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fd6f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366238:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fd6f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366243:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383521.366247:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fd6f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366254:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fd6f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366261:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96350244ba00) 00010000:00010000:1.0:1787383521.366269:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383521.366274:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fd6f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366279:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7e00/0xc40acec91532fd6f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366289:0:17094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x820322f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366310:0:17094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd76 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x820322f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366316:0:17094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x820322f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366321:0:17094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383521.366324:0:17094:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x820322f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366330:0:17094:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd76 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x820322f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366337:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x820322f0 (ffff9635036bcf00) 00010000:00010000:1.0:1787383521.366340:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383521.366343:0:17094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd76 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x820322f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.366348:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd76 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x820322f0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383521.366432:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+30:15654:x1874206966027904:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 476us (711us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787383521.366445:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:0.0:1787383521.374074:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383521.374463:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966028032 00000100:00100000:3.0:1787383521.374472:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966028032 00000100:00100000:3.0:1787383521.374523:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:3.0:1787383521.374532:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+30:15654:x1874206966028032:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383521.374553:0:19236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383521.374576:0:19236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd7d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c3c expref: -99 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.374621:0:19236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fd84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.374633:0:19236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fd84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.374644:0:19236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fd84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.375133:0:19236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd7d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c3c expref: 32 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.375152:0:19236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fd84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c3c expref: 31 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.375176:0:19236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:3.0:1787383521.375179:0:19236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787383521.375183:0:19236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1200, rc 0) 00000100:00100000:3.0:1787383521.375310:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+31:15654:x1874206966028032:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 778us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383521.375318:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:0.0:1787383521.382472:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383521.382587:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966028288 00000100:00100000:1.0:1787383521.382598:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966028288 00000100:00100000:1.0:1787383521.382662:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:1.0:1787383521.382672:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+31:15654:x1874206966028288:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787383521.382754:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd8b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.382812:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.382825:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383521.382997:0:17094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1787383521.383007:0:17094:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 554411240190ns, next at 555411237829ns, rc = 0 00000004:00010000:1.0:1787383521.383052:0:17094:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000772cb0af reply state 00000000f39a494c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd8b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.383066:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.383074:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:1.0:1787383521.383082:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787383521.383085:0:17094:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383521.383172:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+33:15654:x1874206966028288:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 501us (709us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787383521.383180:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:2.0:1787383521.386424:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383521.386638:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966028416 00000100:00100000:3.0:1787383521.386648:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966028416 00000100:00100000:3.0:1787383521.386760:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:3.0:1787383521.386805:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+33:15654:x1874206966028416:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383521.386829:0:19236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383521.386848:0:19236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd92 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c43 expref: -99 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.386903:0:19236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd92 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c43 expref: 34 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.386918:0:19236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd92 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c43 expref: 34 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.386938:0:19236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:3.0:1787383521.386941:0:19236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383521.386945:0:19236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0600, rc 0) 00000100:00100000:3.0:1787383521.387002:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+34:15654:x1874206966028416:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 200us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383521.387024:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:0.0:1787383521.390260:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383521.390360:0:19237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966028544 00000100:00100000:2.0:1787383521.390371:0:19237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966028544 00000100:00100000:2.0:1787383521.390495:0:19237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:2.0:1787383521.390508:0:19237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2401:x1874206966028544:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787383521.390800:0:19237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+6:2401:x1874206966028544:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 261us (683us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787383521.390808:0:19237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00080000:1.0:1787383521.391306:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383521.394130:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383521.394283:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966028800 00000100:00100000:2.0:1787383521.394294:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966028800 00000100:00100000:2.0:1787383521.394360:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:2.0:1787383521.394370:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+34:15654:x1874206966028800:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787383521.394591:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+35:15654:x1874206966028800:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 221us (468us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787383521.394599:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:0.0:1787383521.400534:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383521.400658:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966029056 00000100:00100000:1.0:1787383521.400668:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966029056 00000100:00100000:1.0:1787383521.400729:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:1.0:1787383521.400739:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+35:15654:x1874206966029056:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787383521.400880:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+35:15654:x1874206966029056:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 143us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383521.400899:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:0.0:1787383521.405072:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383521.405383:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966029184 00000100:00100000:3.0:1787383521.405394:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966029184 00000100:00100000:3.0:1787383521.405452:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:3.0:1787383521.405463:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+35:15654:x1874206966029184:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383521.405484:0:19236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383521.405504:0:19236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532fd99 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c4a expref: -99 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.405573:0:19236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91532fda0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.405589:0:19236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91532fda0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.405601:0:19236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91532fda0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383521.405656:0:19236:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383521.405677:0:19236:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91532fda0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.405724:0:19236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91532fd99 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c4a expref: 37 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.405742:0:19236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91532fda0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c4a expref: 36 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.405750:0:19236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:3.0:1787383521.405823:0:19236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787383521.405828:0:19236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1a00, rc 0) 00000100:00100000:3.0:1787383521.405880:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+36:15654:x1874206966029184:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 418us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383521.405888:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:0.0:1787383521.408802:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383521.408950:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966029312 00000100:00100000:2.0:1787383521.408959:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966029312 00000100:00100000:2.0:1787383521.409005:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:2.0:1787383521.409016:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+6:2401:x1874206966029312:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383521.409031:0:18599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383521.409050:0:18599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c3d5866/0xc40acec91532fda7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c51 expref: -99 pid: 18599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383521.409073:0:18599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a894ee1, blocks: 0x0 00010000:00010000:2.0:1787383521.409119:0:18599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=554s v=(0 0) 00010000:00010000:2.0:1787383521.409123:0:18599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383521.409133:0:18599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c3d5866/0xc40acec91532fda7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c51 expref: 7 pid: 18599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.409259:0:18599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c3d5866/0xc40acec91532fda7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c51 expref: 7 pid: 18599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.409272:0:18599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8a00, rc 0) 00000100:00100000:2.0:1787383521.409324:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+7:2401:x1874206966029312:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 311us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383521.409332:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:0.0:1787383521.415345:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383521.415517:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966029568 00000100:00100000:1.0:1787383521.415526:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966029568 00000100:00100000:1.0:1787383521.415741:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:1.0:1787383521.415752:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+36:15654:x1874206966029568:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787383521.416120:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+36:15654:x1874206966029568:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 369us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383521.416129:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:0.0:1787383521.421587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383521.421674:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966029696 00000100:00100000:3.0:1787383521.421684:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966029696 00000100:00100000:3.0:1787383521.421749:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:3.0:1787383521.421759:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+36:15654:x1874206966029696:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787383521.425686:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1787383521.425710:0:17074:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787383521.425762:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1787383521.425986:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6e00/0xc40acec91532fc34 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.426000:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6e00/0xc40acec91532fc34 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.426007:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6e00/0xc40acec91532fc34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.426013:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383521.426017:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6e00/0xc40acec91532fc34 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.426024:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6e00/0xc40acec91532fc34 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.426042:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96350244ba00) 00010000:00010000:3.0:1787383521.426045:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787383521.426050:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6e00/0xc40acec91532fc34 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.426056:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6e00/0xc40acec91532fc34 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383521.426365:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+19:15654:x1874206966029696:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 Request processed in 4603us (4782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383521.426376:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:1.0:1787383521.426616:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787383521.426632:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984980096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787383521.426686:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383521.426731:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984980096 00000100:00100000:1.0:1787383521.426738:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984980096 00000100:00100000:1.0:1787383521.426822:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787383521.426831:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984980096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787383521.426950:0:18600:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787383521.426953:0:18600:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787383521.426955:0:18600:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787383521.426958:0:18600:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787383521 -> 1787383521 00002000:00010000:1.0:1787383521.426960:0:18600:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787383521.427039:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206984980096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 209us (352us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787383521.427046:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787383521.427064:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787383521.427407:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9635037d0a80/2, rc 0, transno 8589934596 00000100:00100000:1.0:1787383521.427416:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984980096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787383521.430663:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383521.430752:0:19676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966029824 00000100:00100000:2.0:1787383521.430762:0:19676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966029824 00000100:00100000:2.0:1787383521.430849:0:19676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:2.0:1787383521.430858:0:19676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeae0f85-81db-4a53-adaf-9a6519b93273+7:2402:x1874206966029824:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787383521.430960:0:19676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeae0f85-81db-4a53-adaf-9a6519b93273+7:2402:x1874206966029824:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 Request processed in 102us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383521.430968:0:19676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00010000:00010000:0.0:1787383521.433495:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8000/0xc40acec91532fbe0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433512:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8000/0xc40acec91532fbe0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433519:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8000/0xc40acec91532fbe0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433525:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383521.433529:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8000/0xc40acec91532fbe0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433571:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8000/0xc40acec91532fbe0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433589:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff96350244b300) 00010000:00010000:0.0:1787383521.433594:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383521.433598:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8000/0xc40acec91532fbe0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433615:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8000/0xc40acec91532fbe0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433636:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8e00/0xc40acec91532fbe7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433643:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8e00/0xc40acec91532fbe7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433649:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8e00/0xc40acec91532fbe7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433654:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383521.433657:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8e00/0xc40acec91532fbe7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433662:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8e00/0xc40acec91532fbe7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433670:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96350244ba00) 00010000:00010000:0.0:1787383521.433673:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383521.433676:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8e00/0xc40acec91532fbe7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433688:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8e00/0xc40acec91532fbe7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433713:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433719:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433726:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433731:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383521.433734:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433740:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433748:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff96350244b800) 00010000:00010000:0.0:1787383521.433751:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383521.433754:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc8f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433759:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8200/0xc40acec91532fc8f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433796:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532fd14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433803:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532fd14 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433816:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532fd14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433821:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383521.433824:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532fd14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433830:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532fd14 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433840:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:0.0:1787383521.433842:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383521.433845:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532fd14 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433851:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8400/0xc40acec91532fd14 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19236 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433863:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433869:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433875:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433880:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383521.433883:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433910:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433919:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:0.0:1787383521.433922:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787383521.433926:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd8b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.433931:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6c00/0xc40acec91532fd8b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383521.435285:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383521.435419:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966030080 00000100:00100000:1.0:1787383521.435428:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966030080 00000100:00100000:1.0:1787383521.435486:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:1.0:1787383521.435495:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+15:15654:x1874206966030080:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787383521.435558:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383521.435580:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91532fda0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c4a expref: 15 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.435597:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:1.0:1787383521.435600:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787383521.435640:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fdae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.435653:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fdae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.435662:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fdae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383521.436274:0:17096:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b4c7bf5 reply state 00000000fd064b47 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fdae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.436290:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fdae lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.436312:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:1.0:1787383521.436315:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787383521.436318:0:17096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787383521.436527:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+16:15654:x1874206966030080:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 1030us (1246us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787383521.436550:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:1.0:1787383521.439999:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383521.440283:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966030208 00000100:00100000:0.0:1787383521.440292:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966030208 00000100:00100000:0.0:1787383521.440382:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:0.0:1787383521.440393:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+7:2402:x1874206966030208:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787383521.440532:0:18602:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787383521.440546:0:18602:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787383520 00002000:00010000:0.0:1787383521.440549:0:18602:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787383520 00002000:00010000:0.0:1787383521.440551:0:18602:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787383521 -> 1787383520 00002000:00010000:0.0:1787383521.440554:0:18602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787383521.440620:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+8:2402:x1874206966030208:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 228us (628us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787383521.440627:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:0.0:1787383521.449724:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383521.449840:0:19237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966030336 00000100:00100000:1.0:1787383521.449850:0:19237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966030336 00000100:00100000:1.0:1787383521.449907:0:19237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:1.0:1787383521.449917:0:19237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636045e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+8:2404:x1874206966030336:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787383521.449962:0:19237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec91532fdb5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.450056:0:19237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383521.450060:0:19237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383521.450067:0:19237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec91532fdb5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.450081:0:19237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec91532fdb5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.450106:0:19237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec91532fdb5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.450114:0:19237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec91532fdb5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.450135:0:19237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec91532fdb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.450143:0:19237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383521.450147:0:19237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec91532fdb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.450157:0:19237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec91532fdb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.450171:0:19237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec91532fdb5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.450178:0:19237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec91532fdb5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383521.450304:0:19237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636045e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+8:2404:x1874206966030336:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 Request processed in 380us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383521.450312:0:19237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:2.0:1787383521.454183:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383521.454267:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966030592 00000100:00100000:1.0:1787383521.454277:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966030592 00000100:00100000:1.0:1787383521.454340:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:1.0:1787383521.454351:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+16:15654:x1874206966030592:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787383521.454425:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.454452:0:17095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fd0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c19 expref: 16 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.454462:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.454496:0:17095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fd0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c19 expref: 16 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.454509:0:17095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fd0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c19 expref: 16 pid: 17096 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383521.454523:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984980224:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383521.454618:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff963601254180 going to sleep for 11 seconds 00000100:00100000:0.0:1787383521.458060:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383521.458138:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966030720 00000100:00100000:3.0:1787383521.458147:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966030720 00010000:00010000:3.0:1787383521.458187:0:17079:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fd0d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c19 expref: 17 pid: 17096 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383521.458232:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:3.0:1787383521.458242:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+17:2402:x1874206966030720:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383521.458259:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383521.458265:0:17079:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fd0d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c19 expref: 17 pid: 17096 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.458279:0:17079:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fd0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c19 expref: 17 pid: 17096 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.458311:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:3.0:1787383521.458317:0:17079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fd29 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c27 expref: 17 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.458328:0:17079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.458335:0:17079:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.458356:0:17079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.458373:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383521.458426:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+17:2402:x1874206966030720:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 185us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383521.458434:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00010000:00010000:1.0:1787383521.459294:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec91532fd0d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c19 expref: 16 pid: 17096 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383521.459325:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984980224:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383521.459345:0:17095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.459354:0:17095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.459359:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.459661:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.459679:0:17095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd92 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c43 expref: 16 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.459687:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.459717:0:17095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd92 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c43 expref: 16 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.459731:0:17095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd92 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c43 expref: 16 pid: 19236 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383521.459745:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984980352:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383521.459866:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635022ce240 going to sleep for 11 seconds 00000100:00100000:1.0:1787383521.465337:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984980352:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383521.465366:0:17095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383521.469155:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383521.470192:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966030848 00000100:00100000:0.0:1787383521.470204:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966030848 00010000:00010000:0.0:1787383521.470262:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd92 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c43 expref: 17 pid: 19236 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383521.470315:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:0.0:1787383521.470324:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+17:2401:x1874206966030848:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383521.470338:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383521.470344:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd92 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c43 expref: 17 pid: 19236 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.470357:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd92 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c43 expref: 17 pid: 19236 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.470378:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0600/0xc40acec91532fd92 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c43 expref: 17 pid: 19236 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.470395:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:0.0:1787383521.470400:0:17081:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.470408:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.470415:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.470443:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383521.470502:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+16:2401:x1874206966030848:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 179us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383521.470509:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00010000:00010000:1.0:1787383521.470820:0:17095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.470828:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383521.470938:0:17095:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787383521.471055:0:17095:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787383521.471089:0:17095:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787383521.471158:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17095:1874206984980480:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787383521.471214:0:17095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383521.471236:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635022cea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383521.471402:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984980480 00000100:00100000:0.0:1787383521.471408:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984980480 00000100:00100000:0.0:1787383521.471443:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787383521.471450:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17095:x1874206984980480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787383521.471535:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17095:x1874206984980480:12345-0@lo:1000:mdt00_001.0 Request processed in 85us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383521.471542:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787383521.471832:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17095:1874206984980480:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787383521.471989:0:17095:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787383521.472036:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17095:1874206984980608:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787383521.472066:0:17095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383521.472089:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620973e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383521.473017:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984980608 00000100:00100000:1.0:1787383521.473026:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984980608 00000100:00100000:1.0:1787383521.473069:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787383521.473076:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17095:x1874206984980608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787383521.473220:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17095:x1874206984980608:12345-0@lo:1000:mdt00_001.0 Request processed in 144us (1152us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787383521.473228:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787383521.473377:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17095:1874206984980608:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787383521.473419:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473429:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473436:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473441:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383521.473446:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473454:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473469:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:2.0:1787383521.473473:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383521.473477:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473482:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91532fdc3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473513:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec91532fd22 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473531:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec91532fd22 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473538:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec91532fd22 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473542:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383521.473545:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec91532fd22 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473551:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec91532fd22 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473559:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:2.0:1787383521.473562:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383521.473569:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fd29 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c27 expref: 19 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473580:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fd29 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c27 expref: 19 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473589:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fd29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c27 expref: 19 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.473653:0:17095:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fd29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c27 expref: 19 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383521.473666:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984980736:192.168.203.2@tcp:105: 00000100:00100000:2.0:1787383521.473741:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620973c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383521.479876:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383521.480402:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17095:1874206984980736:192.168.203.2@tcp:105: 00010000:00010000:0.0:1787383521.480430:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec91532fd22 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.480452:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec91532fd22 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.480489:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fdca lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.480504:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fdca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.480516:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fdca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.480541:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fdca lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.480548:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fdca lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.480555:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fdca lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.480580:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383521.480585:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fdca lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.480592:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fdca lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.481081:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:0.0:1787383521.481085:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383521.481089:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fdca lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.481095:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac8c00/0xc40acec91532fdca lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.481107:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.481114:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.481120:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383521.481125:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966030976 00010000:00010000:0.0:1787383521.481125:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383521.481132:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383521.481135:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966030976 00010000:00010000:0.0:1787383521.481151:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383521.481196:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:1.0:1787383521.481206:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502636050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+20:15653:x1874206966030976:12345-192.168.203.2@tcp:49:dd.0 00000100:00100000:1.0:1787383521.481336:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502636050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+20:15653:x1874206966030976:12345-192.168.203.2@tcp:49:dd.0 Request processed in 131us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383521.481343:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00010000:00010000:0.0:1787383521.481452:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:0.0:1787383521.481457:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787383521.481460:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.481467:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6400/0xc40acec91532fdbc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383521.481712:0:17128:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787383521.481717:0:17128:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787383521.481746:0:17128:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787383521.481755:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787383521.481862:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+19:15654:x1874206966030592:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 27248us (27424us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787383521.481872:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00000020:00080000:0.0:1787383521.481877:0:17095:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787383521.493641:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383521.493684:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383521.493753:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966031232 00000100:00100000:2.0:1787383521.493761:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966031232 00000100:00100000:2.0:1787383521.493831:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:2.0:1787383521.493840:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+19:15654:x1874206966031232:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787383521.494101:0:17098:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787383521.494130:0:17098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787383521.494164:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532fdd1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.494196:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532fdd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.494207:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532fdd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.494216:0:17098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532fdd1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.494223:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532fdd1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.494229:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532fdd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.494250:0:17098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787383521.494329:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+21:15654:x1874206966031232:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 488us (696us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787383521.494338:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000020:00080000:2.0:1787383521.494357:0:17098:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787383521.494936:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383521.494944:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532fdd1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.494954:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383521.494958:0:18626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532fdd1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.494967:0:18626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532fdd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.494981:0:18626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:0.0:1787383521.494984:0:18626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787383521.494988:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532fdd1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.495006:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec91532fdd1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.495020:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383521.495022:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383521.495024:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383521.495193:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966031360 00000100:00100000:3.0:1787383521.495199:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966031360 00000100:00100000:2.0:1787383521.498496:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:2.0:1787383521.498510:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+21:15653:x1874206966031360:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:2.0:1787383521.498530:0:17094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383521.498560:0:17094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec91532fdd8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c58 expref: -99 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.498593:0:17094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532fddf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.498620:0:17094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532fddf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.498631:0:17094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532fddf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.498747:0:17094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec91532fdd8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c58 expref: 23 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.498791:0:17094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532fddf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c58 expref: 22 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383521.498809:0:17094:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:2.0:1787383521.498813:0:17094:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383521.498817:0:17094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9a00, rc 0) 00000100:00100000:2.0:1787383521.498877:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+22:15653:x1874206966031360:12345-192.168.203.2@tcp:101:dd.0 Request processed in 369us (5191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383521.498884:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000040:00080000:2.0:1787383521.691447:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787383521.696706:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383521.696871:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966031488 00000100:00100000:3.0:1787383521.696885:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966031488 00000100:00100000:3.0:1787383521.696973:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:3.0:1787383521.696985:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+8:2402:x1874206966031488:12345-192.168.203.2@tcp:4:dd.0 00010000:00010000:3.0:1787383521.697034:0:18605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.697059:0:18605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c3d5866/0xc40acec91532fda7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c51 expref: 8 pid: 18599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.697069:0:18605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383521.697074:0:18605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383521.697079:0:18605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.697124:0:18605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c3d5866/0xc40acec91532fda7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c51 expref: 8 pid: 18599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.697162:0:18605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c3d5866/0xc40acec91532fda7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c51 expref: 8 pid: 18599 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383521.697181:0:18605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635033bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18605:1874206984980864:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383521.697288:0:18605:0:(client.c:2702:ptlrpc_set_wait()) set ffff963604a92300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383521.699267:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383521.701761:0:18605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635033bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18605:1874206984980864:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383521.701817:0:18605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383521.711139:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383521.711281:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966031744 00000100:00100000:3.0:1787383521.711304:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966031744 00010000:00010000:3.0:1787383521.711362:0:17080:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c3d5866/0xc40acec91532fda7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c51 expref: 9 pid: 18599 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383521.711393:0:18607:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787383521.711404:0:18607:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787383521.711423:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:3.0:1787383521.711434:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+9:2401:x1874206966031744:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383521.711452:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383521.711481:0:17080:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c3d5866/0xc40acec91532fda7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c51 expref: 9 pid: 18599 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.711498:0:17080:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c3d5866/0xc40acec91532fda7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c51 expref: 9 pid: 18599 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.711528:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c3d5866/0xc40acec91532fda7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c51 expref: 9 pid: 18599 timeout: 654 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.711549:0:17080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383521.711563:0:17080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383521.711570:0:17080:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.711582:0:17080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383521.711629:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383521.711708:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+8:2401:x1874206966031744:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 275us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383521.711718:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00010000:00010000:0.0:1787383521.711793:0:18605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.711804:0:18605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383521.713886:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966031616 00000100:00100000:3.0:1787383521.713902:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966031616 00000100:00100000:0.0:1787383521.718226:0:20236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:0.0:1787383521.718259:0:20236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+8:2401:x1874206966031616:12345-192.168.203.2@tcp:4:dd.0 00010000:00010000:0.0:1787383521.718319:0:20236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3ed9db1/0xc40acec91532fded lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.718341:0:20236:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383521.718346:0:20236:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383521.718353:0:20236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3ed9db1/0xc40acec91532fded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.718370:0:20236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3ed9db1/0xc40acec91532fded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787383521.857304:0:19416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1787383521.857348:0:19416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1787383521.857611:0:20236:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1787383521.857618:0:20236:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787383520 -> 1787383521 00002000:00010000:0.0:1787383521.857621:0:20236:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787383520 -> 1787383521 00002000:00010000:0.0:1787383521.857624:0:20236:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 14952 00010000:00010000:0.0:1787383521.857657:0:20236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3ed9db1/0xc40acec91532fded lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.857673:0:20236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3ed9db1/0xc40acec91532fded lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.857684:0:20236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3ed9db1/0xc40acec91532fded lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.857692:0:20236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383521.857699:0:20236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3ed9db1/0xc40acec91532fded lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.857712:0:20236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3ed9db1/0xc40acec91532fded lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.857740:0:20236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3ed9db1/0xc40acec91532fded lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383521.857748:0:20236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3ed9db1/0xc40acec91532fded lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383521.857943:0:20236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eeae0f85-81db-4a53-adaf-9a6519b93273+9:2401:x1874206966031616:12345-192.168.203.2@tcp:4:dd.0 Request processed in 139693us (158678us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787383521.857955:0:20236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00000001:00080000:2.0:1787383521.872847:0:19416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:1.0:1787383521.873147:0:18605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.873167:0:18605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.873178:0:18605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.873185:0:18605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383521.873192:0:18605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.873202:0:18605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.873227:0:18605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383521.873236:0:18605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec91532fde6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383521.873394:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966031488:12345-192.168.203.2@tcp:4:dd.0 Request processed in 176403us (176694us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787383521.873414:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00010000:00010000:2.0:1787383521.946948:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383522.974292:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787383523.473489:0:20274:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1787383523.483204:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984981120:0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.483300:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383523.483340:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984981632:0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.483364:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383523.483382:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984982144:0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.483407:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383523.483434:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787383523.483441:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984981248:0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.483465:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383523.483485:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984981760:0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.483504:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383523.483518:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984982272:0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.483538:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383523.483579:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984981120 00000100:00100000:0.0:1787383523.483599:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984981120 00000100:00100000:0.0:1787383523.483655:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984981632 00000100:00100000:0.0:1787383523.483659:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984981632 00000100:00100000:0.0:1787383523.483676:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383523.483685:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984981120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.483748:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984981120:12345-0@lo:400:kworker.0 Request processed in 63us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383523.483827:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383523.483848:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383523.483854:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984981632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.483885:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984981632:12345-0@lo:400:kworker.0 Request processed in 31us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383523.483890:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383523.483910:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984981248 00000100:00100000:0.0:1787383523.483913:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984981248 00000100:00100000:0.0:1787383523.483947:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984981760 00000100:00100000:0.0:1787383523.483950:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984981760 00000100:00100000:0.0:1787383523.483970:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787383523.483975:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984981248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.484007:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984981248:12345-0@lo:400:kworker.0 Request processed in 32us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383523.484013:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787383523.484025:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787383523.484030:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984981760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.484055:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984981760:12345-0@lo:400:kworker.0 Request processed in 25us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383523.484060:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787383523.484080:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984982144 00000100:00100000:0.0:1787383523.484084:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984982144 00000100:00100000:0.0:1787383523.484116:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984982272 00000100:00100000:0.0:1787383523.484119:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984982272 00000100:00100000:0.0:1787383523.484138:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787383523.484145:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984982144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.484188:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984982144:12345-0@lo:400:kworker.0 Request processed in 43us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383523.484194:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787383523.484205:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383523.484211:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984982272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.484234:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984982272:12345-0@lo:400:kworker.0 Request processed in 24us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383523.484240:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383523.484335:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984981248:0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.484347:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984981760:0@lo:400:kworker.0 00010000:00080000:0.0:1787383523.484359:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f35500 x1874206984982272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383523.484370:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984982272:0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.484381:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984981120:0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.484391:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984981632:0@lo:400:kworker.0 00000100:00100000:0.0:1787383523.484399:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984982144:0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.485791:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984980992:0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.485879:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383523.485944:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984981504:0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.485973:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383523.485998:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984982016:0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.486022:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383523.486037:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984982528:0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.486064:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383523.486090:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787383523.486099:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984981376:0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.486126:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383523.486146:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984981888:0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.486168:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383523.486188:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984982400:0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.486211:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383523.486251:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984981376 00000100:00100000:1.0:1787383523.486260:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984981376 00000100:00100000:1.0:1787383523.486313:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984981888 00000100:00100000:1.0:1787383523.486318:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984981888 00000100:00100000:1.0:1787383523.486344:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787383523.486352:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984981376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.486409:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206984981376:12345-0@lo:400:kworker.0 Request processed in 57us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383523.486416:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787383523.486433:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787383523.486439:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984981888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.486464:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984981888:12345-0@lo:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383523.486480:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787383523.486500:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383523.486506:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383523.486510:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383523.486513:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383523.486538:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984980992 00000100:00100000:1.0:1787383523.486542:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984980992 00000100:00100000:1.0:1787383523.486570:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787383523.486577:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3648:x1874206984980992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.486630:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3648:x1874206984980992:12345-0@lo:400:kworker.0 Request processed in 53us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383523.486636:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787383523.486678:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984981504 00000100:00100000:1.0:1787383523.486682:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984981504 00000100:00100000:1.0:1787383523.486702:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984982016 00000100:00100000:1.0:1787383523.486705:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984982016 00000100:00100000:1.0:1787383523.486715:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984982528 00000100:00100000:1.0:1787383523.486718:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984982528 00000100:00100000:1.0:1787383523.486796:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984982400 00000100:00100000:1.0:1787383523.486799:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984982400 00000100:00100000:1.0:1787383523.486820:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787383523.486826:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984981504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.486859:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206984981504:12345-0@lo:400:kworker.0 Request processed in 33us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383523.486865:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787383523.486878:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787383523.486884:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984982016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.486913:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206984982016:12345-0@lo:400:kworker.0 Request processed in 29us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383523.486926:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787383523.486938:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787383523.486944:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984982528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.486976:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206984982528:12345-0@lo:400:kworker.0 Request processed in 32us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383523.486983:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787383523.486994:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787383523.487000:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984982400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.487028:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984982400:12345-0@lo:400:kworker.0 Request processed in 29us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383523.487035:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787383523.487054:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383523.487057:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383523.487097:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1787383523.487106:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9635037d0a80, transno 8589934596 00000004:00080000:1.0:1787383523.487121:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1787383523.487151:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206984981376:0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.487166:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984981888:0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.487176:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984982400:0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.487187:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984980992:0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.487198:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206984981504:0@lo:400:kworker.0 00000100:00100000:1.0:1787383523.487209:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206984982016:0@lo:400:kworker.0 00010000:00080000:1.0:1787383523.487221:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f34700 x1874206984982528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383523.487241:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984982528:0@lo:400:kworker.0 00000100:00100000:2.0:1787383523.487678:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383523.491009:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984982656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383523.491111:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383523.491233:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984982656 00000100:00100000:1.0:1787383523.491245:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984982656 00000100:00100000:1.0:1787383523.491318:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787383523.491329:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984982656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383523.491375:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787383523.491445:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984982656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383523.491454:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787383523.491519:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984982656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383523.499428:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984982784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383523.499526:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383523.499612:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984982784 00000100:00100000:1.0:1787383523.499621:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984982784 00000100:00100000:1.0:1787383523.499678:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787383523.499687:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984982784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787383523.499730:0:18604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787383523.499806:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984982784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383523.499815:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787383523.499873:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984982784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383523.500089:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984982912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383523.500123:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383523.500499:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984982912 00000100:00100000:0.0:1787383523.500507:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984982912 00000100:00100000:0.0:1787383523.500558:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787383523.500568:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984982912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383523.500583:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787383523.500644:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984982912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383523.500660:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787383523.500750:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984982912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787383523.997364:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42673 lines, 42673 kept, 0 dropped, 0 bad.